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| In an attempt to overcome the weaknesses of the traditional school 

organization many progressive schools have developed new programs. 
These programs are so similar in character that collectively the 
changes have been referred to as the activity movement. This 
movement has claimed the center of the educational stage for a length 
of time sufficient to have engendered widespread interest in its out- 
| comes and in its basic philosophy. é; 

In Doctor Hissong’s study an attempt has been made to discover 
the principles underlying the present activity movement, to determine 
the influence of traditional concepts in shaping the trends of the 
movement, and to see if in the light of the present knowledge of the 
child and his relation to his environment the movement rests upon a 
justifiable basis. 








| 


$2.00 plus 10¢ postage 


WARWICK AND YORK 


Publishers BALTIMORE 





Watt 


>, 








wd 


M OND 
ge, 


‘sity 


foreig 
1. Bae 
e yea 


r week 
ims { 


$ alte 


Man 
ditori 


MD 


er 
ne 
he 
he 








THE JOURNAL OF 
EDUCATIONAL PSYCHOLOGY 








Volume XXVII September, 1936 Number 6 








A STUDY OF THE ADJUSTMENT DIFFICULTIES OF A 
GROUP OF WOMEN TEACHERS 


LEIGH PECK 
The University of Texas 


This study of the adjustment difficulties of a group of one hundred 
women teachers was made with the purpose: (1) To ascertain the 
proportion of the women teachers that were maladjusted, as judged 
by some objective standard, and to compare their adjustment with 
that of women students and with that of men; (2) to note the incidence 
of traits and habits that might be of especial significance in affecting 
a teacher’s professional activities; (3) to study the relation to malad- 
justment of age, marital status, and extent and type of experience; 
(4) to determine what problems required from the teachers a con- 
scious effort to adjust; (5) to note the relation of adjustment to 
intelligence; and (6) to compare self-estimates of adjustment with 
objective measurements of adjustment. 


PREVIOUS STUDIES 


Within the last ten years, several studies have been made of 
teachers’ attitudes toward the adjustment problems of their pupils, 
and several recent textbooks in mental hygiene include chapters 
discussing the mental health of the teacher, assuming that teachers’ 
own maladjustments influence their attitudes toward pupils’ malad- 
justments. There have been, however, few investigations of the 
mental health of teachers. 

In 1930, Goodwin Watson! reported a study of ‘‘ Happiness among 
Adult Students of Education.’’ His subjects were three hundred 
eighty-eight graduate students (averaging thirty years of age) in 
Teachers College, Columbia University. In securing his data, 





1 Watson, Goodwin: “‘Happiness among Adult Students of Education.” 
Journal of Educational Psychology, Vol. X XI, 1930, pp. 79-109. 
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he had his subjects check their own estimates of their happiness on a 
five-point scale, had them choose phrases and adjectives descriptive 
of their emotional state, asked them to compare their present happiness 
with that in earlier years, gave them an Otis intelligence test, and 
secured answers to an extended questionnaire that included questions 
concerning childhood environment, scholarship, extra-curricular activ- 
ities, recreations, and other topics. From these data, especially by 
comparing the fifty happiest with the fifty least happy, he derived 
an extensive list of conclusions, of which the following are most 
relevant to the present study: (1) Men believe themselves to be happier 
than women believe themselves to be; (2) age is not significant for 
happiness; (3) the married are happier than the unmarried; (4) 
intelligence bears no relation to happiness; (5) the general level of 
happiness can be measured with adequate reliability by a single 
check on one graphic scale. 

Frances‘ V. Mason,!' in 1931, reported ‘‘A Study of Seven Hundred 
Maladjusted School Teachers.” She secured her data from the 
records of seven hundred thirty-three patients (one hundred ninety 
men, five hundred forty-three women) in four hospitals for mental 
diseases, going back as far as 1880 for some of the records. She 
found that these teachers had been admitted to the hospitals at an 
earlier average age (57.9 per cent by the age of forty) than non- 
teachers. However, school troubles were mentioned as contributing 
causes of illness in only thirty-two of the two hundred fourteen 
cases for which information concerning contributing causes could 
be obtained. Paranoia was more often found among the teachers 
than among non-teachers. More than half of all the teachers were 
described as being, before their illness, sensitive, shy, or seclusive. 
As a group, they lacked social and recreational interests; reading, 
study, and religion were said to be their chief extra-curricular interests 
before their illness. About three-fifths were in poor physical condition. 


PRESENT INVESTIGATION 


The present investigation was concerned chiefly with the adjust- 
ment difficulties of a group of one hundred women teachers, enrolled 
in the author’s classes in The University of Texas during the summer 
of 1935. As control groups, fifty-two women students who were not 
teachers, and twenty-six men (teachers and prospective teachers), 





1 Mason, Frances V.: ‘‘A Study of Seven Hundred Maladjusted School Teach- 
ers.”” Mental Hygiene, Vol. XV, 1931, pp. 576-599. 
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in the same classes, were also studied. These one hundred seventy- 
eight subjects checked the Thurstone Personality Schedule, as a 
measure of adjustment or maladjustment; took the Otis Self-Adminis- 
tering Test of Mental Ability, Higher Examination, Form A; filled 
out a personal data sheet, giving age, marital status, teaching expe- 
rience, if any, and estimate of own adjustment, on a five-point scale; 
and furnished an informal written statement of the problems to 
which the subject was making a conscious effort to adjust. In supply- 
ing this information, the subjects remained entirely anonymous. At 
the beginning of the investigation, they drew for slips of paper on 
which numbers had been written, and they signed all papers pertaining 
to the investigation by number rather than by name. 


RESULTS 


1. Scores on the Thurstone Personality Schedule 


The highest possible score on the Thurstone Personality Schedule is 
two hundred twenty-three; scores between thirty and fifty-nine are 
considered as average. The mean scores of all three groups included 
in the present study fall within the average limits; however, the women 
teachers evidence a greater number of maladjustments than do the 
women students or the men; and the women as a whole evidence a 
greater number of maladjustments than do the men. For the men, 
the mean is forty-one, the range two to one hundred; for the women 
students, the mean is forty-five, the range ten to ninety-eight; for 
the women teachers, the mean is fifty, the range eight to one hundred 
eighty-five. These figures are in agreement with Watson’s finding 
that men believe themselves to be happier than women believe them- 
selves to be. 

Only five of the women students stated that they did not intend to 
teach; their mean score is forty-nine, as compared with the mean of 
forty-five for the entire group of women students. Thus, as far as 
can be judged from this small group, there is no evidence that it is the 
women students already maladjusted who tend to enter the teaching 
profession. 

No difference in mean score is observed in comparing the men 
students (all prospective teachers) with the men teachers; the mean 
score of the former (N = 20) is 41.2, for the latter (N = 6), 41.5. 
Thus, though the women teachers are more maladjusted than the 
women students, the men teachers are as well adjusted as the men 
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students. Apparently, if teaching as a profession tends to produce 
maladjustments, the occupational hazards are more serious for women 
than for men. 

Scores on the Thurstone Personality Schedule may be interpreted 
in terms of letter grades A, B, C, D, and EF, corresponding to the 
descriptive phrases ‘‘extremely well adjusted,” ‘well-adjusted,” 
‘“‘average,” “‘emotionally maladjusted,” and ‘should have psychiatric 
advice.”’ These letter grades and descriptive phrases were arbitrarily 
selected by Thurstone to designate five groups of scores: 0-14, A; 
15-29, B; 30-59, C; 60-79, D; and 80 or above, £. 


TABLE I.—CoMPARISON OF SCORES ON THURSTONE PERSONALITY SCHEDULE 














Percentages making score 
Chicago 
s G D ipti h 
core nate escription freshmen Women ae —— 
(N = 682) 
teachers students 
(N = 100) | (N = 52) | (N = 26) 
0-14) A Extremely well adjusted. 16 05 06 11.5 
15-29} B Well adjusted. 29 14 21 15 
30-59} C Average. 41 48 50 58 
60-79} D Emotionally maladjusted. 10 21 08 11.5 
80- E Should have psychiatric advice. 04 12 15 04 























Table I shows the classification in terms of letter grades of the 
subjects of the present investigation, and includes a comparison of 
their grades with those of subjects used by Thurstone in standardizing 
the test. It will be seen from Table I that under a system of classifica- 
tion so liberal that Thurstone could designate forty-five per cent of 
his subjects as ‘‘ well adjusted ”’ or ‘‘extremely well adjusted,” forty-one 
per cent as ‘‘average,’”’ and only fourteen per cent as “‘maladjusted”’ 
or ‘‘in need of psychiatric advice,” thirty-three per cent of the women 
teachers are classified as ‘“‘maladjusted” and twelve per cent of these 
are ‘‘in need of psychiatrice advice.’”’ Only nineteen per cent are 
‘““well adjusted” or ‘extremely well adjusted.” It may also be seen 
from Table I that the women students, though making a better 
showing than the women teachers, include more “maladjusted” 
and fewer “well adjusted” individuals than do the members of the 
Thurstone group. The men, though showing a percentage of malad- 
justment almost as low as that in Thurstone’s group, have a relatively 
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low percentage of the well adjusted. In other words, even the men 
teachers and prospective teachers included in the present study are 
not, on the whole, quite so well adjusted as the subjects upon whom 
Thurstone’s test was standardized; the women students are still 
less well adjusted; and the women teachers least of all, to the extent 
that thirty-three per cent are classified as definitely maladjusted and 
twelve of these in need of psychiatric advice. 


2. Comparison of Responses to Selected Questions 


From the two hundred twenty-three questions in the Thurstone 
Personality Schedule, forty-four items were selected arbitrarily by the 
present investigator as relating to traits or habits that might be of 
especial significance in affecting a teacher’s professional activities. 
These forty-four items are shown in Table II, classified under the 
headings: (1) Undesirable emotional reactions, (2) unfavorable 
personality traits, (3) social handicaps, (4) poor work habits, (5) 
incapacitating physical symptoms, (6) history of previous maladjust- 
ments, and (7) sex problems. The percentage of teachers answering 
affirmatively each of the forty-four questions is indicated in the 
first column in Table II. It is interesting to speculate as to the 
possible effect on pupils of the fact that nearly one-third of these 
teachers feel themselves deserving of a better lot in life, one-fifth 
report themselves to be frequently in low spirits, and one-fourth often 
in a state of excitement; one-third describe themselves as nervous, 
one-sixth admit that they lose their tempers quickly, one-fourth are 
upset easily; one-third are shy, one-fourth are critical of other people; 
one-fourth do not plan their work ahead, and an equal number dislike 
to take responsibility; one-fourth frequently suffer from indigestion, 
and one-fifth are tired most of the time; one-tenth have had a nervous 
breakdown, and one-fourth fear insanity; one-fourth are suffering 
from a conflict between sex and morality. 

The second column in Table II indicates the number of women 
students answering affirmatively the forty-four selected questions, 
and the third column compares the teachers’ responses with the 
students’ responses by giving the critical ratio (that is, the difference 
divided by the sigma of the difference). If a difference equal to 
at least three sigma be used as the criterion of a significant difference, 
it will be seen that the responses of the women teachers differ from 
those of the women students significantly only in item 22: ‘‘Saying 
things that hurt people’s feelings.’”’ Here the affirmative responses 
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TaBLE II.—CoOMPARISON OF RESPONSES TO THURSTONE PERSONALITY SCHEDULE 











Ty we ee 




















Percentages Percentages 
Responses Women Women Criti Ww ait 
saaghenn | chudente ritical omen Men Critical 
(N = 100)| (N = 52) ratio | (N = 152) (N= 26)| ratio 
I. Undesirable emotional reac- 
tions. ; 
1. Feels unadjusted to life. 17 29 1.64 21 37 1.59 
,2. Feels life a great burden 08 06 .47 07 11 .61 
3. Feels deserving of a 
better lot in life..... 30 21 1.39 27 26 .10 
4. Worries over possible 
misfortunes......... 37 33 .49 36 26 1.05 
5. Worries over the tasks 
Fee 06 10 . 83 07 07 .00 
SO rere 37 29 1.27 34 05 5.05 
7. Frequently in low 
ake ead we Oe 22 15 1.08 20 18 .24 
8. Often in a state of ex- 
G@etement........eess. 25 21 . 56 23 00 6.74 
II. Unfavorable personality 
traits. 
re 33 33 .00 33 18 1.77 
10. Lacks self-confidence. . 30 30 .00 30 30 .00 
11. Feelings easily hurt.... 37 40 .36 38 52 1.32 
12. Disturbed by criticism. 31 23 1.07 28 15 1.65 
13. Loses temper quickly. . 16 08 1.52 13 15 . 26 
14. Confused easily....... 30 35 .62 32 11 2.91 
15. Discouraged easily..... 45 50 .58 47 30 1.72 
16. Upset easily.......... 23 21 .28 22 00 6.54 
. Social handicaps. 
IR alae dine) y 4edo e 33 35 24 34 33 .10 
18. Has difficulty in speak- 
ing in public........ 46 44 .23 45 22 2.53 
19. Has difficulty making 
ides sae s\0-9 a's 16 23 1.01 18 15 .39 
20. Finds books more in- 
teresting than people 18 18 .00 18 30 1.26 
21. ee interested in 
Ns one ee awed 08 06 .47 07 15 1.09 
22. Says inns that hurt, 
people’s feelings... .“ 15 02 3.20 10 1l 15 
23. Has habit of contradict- 
ing people.......... 10 12 .37 11 11 .00 
24. Critical of other people 24 13 1.74 20 26 .65 
. Poor work habits. 
25. Mind wanders badly... 16 12 .69 14 15 .13 
26. Does not plan work 
pea 23 21 .28 22 22 .00 
27. Leaves many tasks un- 
te isan hth oa 28 23 .65 26 18 .96 
28. Dislikes to take respon- 
sa et ane eetes 26 23 .40 25 18 . 84 
. Incapacitating physical 
symptoms. 
29. Poor appetite......... 07 04 .80 06 04 .44 
30. Frequent indigestion. . 26 18 1.16 23 22 an 
0 ee 09 10 a 09 11 .30 
32. Many headaches...... 10 10 .00 10 11 15 
33. Fatigue upon awaking. 21 19 .29 20 22 .30 
34. Tires of work quickly. . 27 36 1.12 30 18 1.43 
35. Feels tired most of time 21 30 1.19 24 22 .30 
. History of maladjustments. 
36. Unhappy home _  en- 
vironment........... 06 04 .55 05 07 .37 
37. Unhappy childhood. . 15 18 .46 16 04 2.47 
38. Unhappy adolescence. . 20 12 1.32 17 07 1.70 
39. Nervous breakdown... . 11 08 . 58 10 04 1.32 
40. Fear of insanity....... 24 15 1.38 21 11 1.43 
41. Desire to commit sui- 
SR sacs arene aie hls wR aH 14 18 .62 15 07 1.38 
: oy roblems. 
norance of sex....... 14 15 .16 14 00 5.00 
—e i sexual infe- 
Gee 15 10 91 13 07 1.05 
44. Conflict. between sex 
and morality........ 25 21 .56 24 37 1.28 





—— << #8~=— 


ne 


QR > + 2 ee A 








Adjustment Difficulties of Women Teachers 407 


of the teachers exceed those of the students so appreciably that the 
critical ratio is 3.2. 

The fourth column in Table III presents the percentage of affirma- 
tive responses made by the women teachers and women students 
combined, and the fifth column shows the percentage of affirmative 
responses made by the men. The sixth and last column compares 
the responses of the women with those of the men, giving the critical 
ratio (the difference divided by the sigma of the difference). If a 
difference of at least three sigma be again taken as the criterion of a 
significant difference, we find that the women differ from the men 
with respect to traits that are possibly related to differences in physical 
constitution: The women (1) are more moody; (2) are more frequently 
in a state of excitement; and (3) are upset more easily. The women 
also more often consider themselves ignorant of sex. The differences 
closely approach the criterion of three sigma with respect to three other 
items: The women (1) are confused more easily; (2) have more diffi- 
culty in speaking in public; and (3) have had a more unhappy child- 
hood than the men. 

In the remaining thirty-seven of the forty-four items, the differences 
between the responses of the men and those of the women do not 
satisfy the criterion for significant difference. 


3. Factors Apparently Related to Personality Scores 


Teachers are often told that if they can effect a happy adjustment 
of the children in their care, they will promote the future mental health 
of these children, grown to adulthood. This theory is somewhat 
substantiated by the records of the subjects of the present study. 
In Table III are tabulated separately the scores on the Thurstone 
Personality Schedule of the subjects reporting a happy childhood and 
adolescence and the scores of those reporting unhappiness in childhood 
or adolescence or both. In each group, a large difference in score 
favors the subjects who had a happy childhood and adolescence: 
among the women teachers, an average of forty-four symptoms of 
maladjustment for “happy” group, as compared to sixty-two for 
the ‘‘unhappy”; among the women students, an average score of 
thirty-nine, as compared to sixty-four; and among the men, an average 
score of 37.5, as compared to fifty. 

Watson, in his study of ‘‘The Happiness of Adult Students of 
Education,”’ found no indication that age affected the scores of his 
subjects. Age does, however, affect markedly the scores on the Thur- 
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stone Personality Schedule of the subjects of the present investigation. 
As shown in Table III, the scores of the men decrease (improve) 
steadily with age: twenty years and under, average score sixty-three; 
twenty-one to twenty-five years, average score forty; and twenty-six 
to thirty years, average score twenty-two. There is also a slight 
decrease with age in the scores of the women students: twenty years 
and under, average score forty-seven; twenty-one to twenty-five 
years, average score forty-five. In the case of the women teachers, 
the number of symptoms of maladjustment is highest in the years 
twenty-six to thirty, an average of fifty-six, and drops to an average of 
forty-one for the years of thirty-one and above. The teachers’ own 
reports of their adjustment problems indicate that in the late twenties 
difficult decisions have to be made with respect to marrying or staying 
single, locating a relatively permanent position, and completing one’s 


TaBLeE III.—Factors RELATED TO AVERAGE SCORES ON THURSTONE PERSONALITY 














ScHEDULE 
Women teachers | Women students Men 
(N = 100) (N = 52) (N = 26) 
Number | Average | Number| Average | Number | Average 
reporting| score jreporting} score jreporting| score 
1. Happiness in childhood and adoles- 
cence. 
(1) Group reporting happiness..... . 70 44 42 39 23 37.5 
(2) Group reporting unhappiness... 30 62 10 64 3 50 
2. Age. , 
(1) Twenty and under............. 8 53 35 47 5 63 
(2) Twenty-one to twenty-five...... 46 51 13 45 15 40 
(3) Twenty-six to thirty........... 21 56 7 week 5 22 
(4) Thirty-one and over............ 19 41 
3. Marital status.! 
cL cee nake ead ke tedane 68 49.5 43 47 20 45 
RE rn ee ae 16 53 6 43.5 6 41 
fe ee ee 9 35 
4. Number of years of teaching experi- 
ence.! 
4. cieaenseneeeeces eee 10 59 
(2) Two to five years.............. 47 51 
(3) Six to tem years................ 19 47 
(4) Over ten years................ 15 42 
5. School grades taught.! 
Pe cetccnnerebas sap acdeens 20 ’ 47 
ensign Shen nebeess 50 53 
i so caw esecegeees 14 47 
(4) High School................+..-. 10 40 























1 This information was not furnished by some subjects. 
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education. The necessity for these decisions does not become so 
pressing in earlier years; and in later years the decisions have already 
been made and the individual reconciled to her lot. Thus the late 
twenties stand out as a relatively perturbed period in lives of many 
women teachers. 

Watson found that the married were happier than the unmarried. 
The figures given in Table III indicate that, among the subjects of 
the present investigation, the married women students are somewhat 
better adjusted than the unmarried (with an average score on the 
Thurstone Personality Schedule of 43.5 as compared to forty-seven), 
and that the married men are somewhat better adjusted than the 
single men (with an average score of forty-one as compared to forty- 
five). Among the women teachers, however, the married women are 
worst adjusted, with an average score of fifty-three; the single women 
next, with an average score of 49.5; and the widows best adjusted, 
with an average score of thirty-five. The favorable score of the 
widows, as compared with the single women, may be influenced by an 
age factor, for the average age of the widows is 37.5, of the single 
women, twenty-four; and, as already noted, there is a decrease in the 
average number of maladjustment symptoms after the age of thirty 
is reached. However, the difference between the married women 
and the widows cannot so easily be explained as the result of an age 
factor, for the average of the married women is thirty-two, within the 
age limit in which symptoms of maladjustment tend, in general, to 
decrease. These married women teachers may be a group selected 
(that is, forced to teach in the winter and attend school in the summer) 
by some factor strongly tending in itself to produce maladjustment. 
That is, many of them might not be professionally active unless some 
financial exigency or family difficulty forced them out of their homes. 

Teachers often allege that “‘the first year is the hardest.”’ This 
assertion is substantiated in part by the fact, as shown in Table III, 
that the women teachers with only one year of experience record on 
the average fifty-nine symptoms of maladjustment on the Thurstone 
Personality Schedule; the teachers with two to five years of experience, 
fifty-one; those with six to ten years of experience, forty-seven; and 
those with more than ten years of experience, only forty-two. 

Table III further shows that the highest average number of 
maladjustment symptoms is recorded for the primary teachers, 
with an average score of fifty-three on the Thurstone Personality 
Schedule; the rural teachers and the intermediate teachers average 
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forty-seven; and the high-school teachers manifest fewest symptoms 
of maladjustment, with an average score of forty. 

A further analysis of the factors apparently related to the per- 
sonality scores and grades of the women teachers is presented in 
Table IV. An examination of Table IV shows that the women 
teachers making personality grades of B and A (“‘well adjusted” 
and ‘‘extremely well adjusted”) are distinguished from those making 
a grade of C (the ‘‘average”’ group) by being older (thirty-one or 
thirty-two years as compared to twenty-six years) and by having 
taught longer (nine years as compared to five years). Moreover, 
the ‘‘extremely well adjusted” teachers report an average of only 
two problems to which they are consciously endeavoring to adjust, as 
compared to 4.2 problems reported by the ‘‘ well adjusted”’ group and 
4.8 problems reported by the “‘average”’ group. The D and E groups 
(“emotionally maladjusted” or ‘in need of psychiatric advice”’) 
are slightly younger than the ‘‘average” group, but probably not 
significantly so (25.9 and 24.8 years as compared with twenty-six 
years), and have taught approximately the same length of time as the 
‘“‘average”’ group (5.2 and 5.1 as compared to 5.3 years). They do, 
however, differ noticeably from the “‘average” group in the number of 
problems to which, according to their own report, they are consciously 
trying to adjust (6.75 and six, as compared to 4.8 for the ‘“‘average”’ 
group). 


TaBLeE IV.—Factors RELATED TO THE PERSONALITY GRADES OF THE WOMEN 








TEACHERS 
Percentage Average avenge 
number of y 
—— making Average age teaching alist Average 
grade of group experience saiiien Otis score 
(N = 100) (in years) listed 
A 5 31.0 9.4 2.0 52.6 
B 14 32.5 9.0 4.2 52.0 
C 48 26.0 5.3 4.8 50.6 
D 21 25.9 5.2 6.75 54.8 
E 12 24.8 5.1 6.0 51.7 




















4. Sources of Maladjustment Reported by Women Teachers 


The subjects of the present study were asked to write out, in an 
informal fashion, a statement of the problems to which they were 
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consciously trying to adjust, the problems which they felt to be more 
or less a source of maladjustment. Some responded in the briefest 
possible phrases; others submitted as many as eight or ten closely 
written pages detailing the difficulties which confronted them. The 
problems reported by the women teachers are summarized in Table V. 
These one hundred subjects list a total of five hundred four problems, 
an average of five each. As already noted in Table IV, however, the 
“extremely well adjusted” teachers list an average of only two 
problems each, while the ‘‘maladjusted” teachers list on the average 
of six or more problems each. As indicated in Table V, one-fifth 
of all the women teachers report difficulty in securing comfortable 
living accommodations, one-third deplore the lack of congenial 
associates, one-fourth suffer from lack of recreational facilities, one- 
fifth find their social activities too-narrowly restricted by community 
prejudices, and one-fifth consider themselves overburdened with 
religious and educational activities outside the school. These facts 
deserve emphasis in view of Mason’s finding, that lack of recreational 
and social interests seemed related to the mental illnesses of the 
teachers whose records she studied. 

One-half the women teachers with whom the present study is 
concerned complain of heavy teaching load. Numerous studies 
have been made of the effect of large classes on efficiency in academic 
instruction. Perhaps some attention should be directed to the 
effect on the mental health of the teacher of the continued strain of 
adjusting her own personality to the personalities of large groups of 
children. One-fifth of these teachers fear the loss of their positions. 
One-fourth consider their salaries inadequate, and one-fifth have 
financial problems of a personal nature, aside from any question as to 
the adequacy of their salaries. One-fifth report health problems 


serious enough to be sources of maladjustment; overfatigue is most 
often mentioned. 


5. Intelligence Test Scores 


The scores on the Otis Self-Administering Test of Mental Ability 
(Higher Examination) may be interpreted in terms of point scores, 
letter grades, or intelligence quotients. The average point score for 
the women teachers is fifty-two, with a range of twenty-seven to 
seventy-three; for the women students fifty-three, with a range of 
thirty-seven to seventy-three; for the men fifty-seven, with a range of 
forty-one to sixty-nine. In each group the average letter score is 
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TasBLE V.—Sources OF MALabDsJusTMENT LisTED BY ONE HUNDRED WoMEN 
TEACHERS 
I. Community conditions. 
1. Adjustment to new community................ 0.0... cece eee eee 10 
2. Lack of desirable living arrangements........................... 21 
ee es oss 415 sss iSle SN wie WWW 86 w Slee O:6:0.6 dares 33 
4. Lack of recreational facilities.............cccccccccccccccccccees 24 
5. Restrictions on teachers’ social activities and personal conduct... .. 19 
6. Imposition of extra duties (such as Sunday School teaching or 
EER I 5 SR aa, 2 a ee a tee A Sa 21 
II. Teaching conditions. 
Oe EE CE ee eT eee ee ee Pere 4 
2. Work with backward or maladjusted children.................... 11 
EEE LIE POS LE Se 5 
EE re re 5 
5. Friction with superintendent, principal, or supervisor............. 13 
6. Friction in community affecting the school........................ 11 
7. Heavy teaching load (too many classes, too large a group of pupils). 49 
EE I ee A 13 
EE rere 5 
10. Heavy extra-curricular duties... ......... ccc cc cece cece cc ccccces 11 
11. Uncongenial tasks (assignment to teach in undesirable part of town, 
to teach subjects not liked, or to teach grades not preferred).... 8 
12. Burdensome requirements for professional self-improvement....... 5 
13. Uncertainty of temure im position... 0.0.0... ccc cece cece ccccces 19 
EOE I Ee te re 24 
EE ee 5 
III. Personal problems. 
Ee Se oe ee ee eee 20 
Cee ie he he Bian eas PAR US ek ee Male a6 4 20 
3. Worry over welfare of relative or friend....................000055 14 
4. Inharmonious relationships with members of family or other inti- 
ete aha eee ee Cannas Gb dae aks ORR oo ORR 7 
I os cl aa ow we bo 5G ee bess 66 os ve eeeee bs 15 
6. Mental and emotional conflicts.......................000 cee eeee 15 
i ds kg wl Wale Dik ad's ira aed aia Wa 97 
ee en ska s wesw Ke ke oe beeen diee 18 
ts ce on eke WA ww deeb wee ee 12 
i aa ik eae a 6456 Bbuk 0 wi-9 ted 17 
Re ee ee ne ee 39 
Seen 6s 4 ole dd JaGadentn anenes 11 
ARERR RCE aia ENP) cee gr a ee eT a ee ee ery 504 


B, with a range from C— to A for the women teachers, C to A for the 
women students, and C+ to A for the men. The Otis 1Q’s for the 
women teachers average one hundred ten, with a range of eighty-five 
to one hundred thirty-one; for the women students, one hundred 
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eleven, with a range of ninety-five to one hundred thirty-one; for the 
men, one hundred fifteen, with a range of ninety-nine to one hundred 
twenty-seven. The Otis test was, of course, inadequate to measure the 
ability of the more intelligent subjects. 

The correlations between intelligence, as measured by the Otis 
test, and adjustment, as measured by the Thurstone Personality 
Schedule, are positive but very low: For the women teachers, +.06 + 
.06; for the women students, +.03 + .08, and for the men, +.14 + .12. 
Evidently intelligence is but a negligible factor in adjustment, and 
possibly of even less value to the women than to the men. It will 


be recalled that Watson found no relationship between happiness and 
intelligence. 


6. Correlations of Personality Scores with Self-estimates of Adjustment 


On their personal data sheets the subjects of the present investiga- 
tion recorded self-estimates of their adjustment on a five-point scale: 
Unusually good, above average, average, below average, or unusually 
poor. The correlations are positive but low between these self- 
estimates of adjustment and the letter grades indicative of degrees of 
adjustment (A, B, C, D, E) derived from the scores on the Thurstone 
Personality Schedule. For the women teachers the correlation is 
+.10 + .06; for the women students, +.38 + .09; for the men, 
+.31 + .12. If, then, scores on the personality test can be taken as 
criteria of adjustment, the subjects of the present study are quite 
unsuccessful in evaluating their own mental health, and the women 
teachers are even less accurate in their estimates then are the women 
students and the men. 

Watson referred to no objective criterion when he said that “the 
general level of happiness can be measured with adequate reliability 
by a single check on one graphic scale.’”” He simply compared the 
subjects’ self-estimates on a five-point scale with other types of self- 


estimates (such as the checking of descriptive phrases), finding a high 
correlation between the two. 


SUMMARY AND CONCLUSIONS 


The present investigation sought to ascertain the adjustment 
difficulties of a group of one hundred women teachers. Control 
groups, consisting of fifty-two women students (nearly all prospective 
teachers) and twenty-six men (teachers and prospective teachers) 
were also studied. Data were secured by means of the Thurstone 
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Personality Schedule, the Otis Test of Mental Ability, personal data 


- sheets, and informal statements of the problems to which the subjects 


were making a conscious effort to adjust. The following conclusions 
seem justified: 

1. The women teachers are not so well adjusted as the women 
students, and the women as a whole are not so well adjusted as the 
men, if the Thurstone Personality Schedule can be considered a 
valid measure of maladjustment. 

2. One-third of the women teachers are definitely maladjusted, 
and one-sixth need psychiatric advice, as judged by the Thurstone 
Personality Schedule. Only one-fifth can be classified as well-adjusted. 

3. The symptoms of maladjustment most common among the 
women teachers include the following: One-third feel deserving of a 
better lot in life, one-fifth are frequently in low spirits, one-fourth are 
frequently in a state of excitement; one-third describe themselves as 
nervous, one-sixth admit that they lose their tempers quickly, one- 
fourth are upset easily; one-third are shy; one-fourth are critical of 
other people; one-fourth do not plan their work ahead, and an equal 
number dislike to take responsibility; one-fourth frequently suffer 
from indigestion, and one-fifth are tired most of the time; one-tenth 
have had a nervous breakdown, and one-fourth fear insanity; one- 
fourth are suffering from a conflict between sex and morality. 

4. Though the women teachers report a greater number of 
maladjustment symptoms than do the women students, no appreciable 
difference in the percentage reporting any one given symptom is 
found except with respect to the item, ‘‘saying things that hurt 
people’s feelings.’”’ This is reported significantly more often by the 
teachers than by the students. 

5. Though the women as a whole report a greater number of 
maladjustment symptoms than do the men, reliable differences are 
found with respect to the following items only: The women are more 
moody, are more frequently in a state of excitement, and are upset 
more easily; they also more often consider themselves ignorant of 
sex. The criterion for a reliable difference is approached in three 
other items: The women are confused more easily, have more difficulty 
in speaking in public, and have had a more unhappy childhood than 
the men. 

6. More symptoms of maladjustment are reported by subjects 
who say they were unhappy in childhood or adolescence than by those 
who say they were happy then. 
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7. In general, adjustment improves with age. The peak of 
maladjustment, however, is reached by the women teachers between 
the ages of twenty-six and thirty. sh. fo’ 

8. Among the men and among the women teachers, the married 
are better adjusted than the unmarried; but among the women teachers 
studied, the widows are best adjusted, the single women next, and 
the married women worst adjusted. 

9. Among the women teachers, adjustment improves as teaching 
experience increases; those who have taught one-year are worst 
adjusted, those who have taught more than ten years are best adjusted. 

10. Of the women teachers, those in the primary grades are worst 
adjusted, those in the high school best adjusted. 

11. Relatively few problems (an average of two) causing a con- 
scious effort to adjust are reported by the group of teachers classified as 
“extremely well adjusted,” but a relatively large number (an average 
of six or more) is reported by the group classified as ‘‘maladjusted.”’ 

12. The problems most often reported by the women teachers 
include the following: One-fifth find difficulty in securing comfortable 
living accommodations, one-third lack congenial associates, one-fourth 
lack recreational facilities, one-fifth find their social activities restricted 
by community prejudices, and one-fifth are overburdened by religious 
and educational activities outside the school; one-half consider their 
teaching load too heavy; one-fifth fear the loss of their positions, one- 
fourth consider their salaries inadequate, and one-fifth have financial 
problems of a personal nature, aside from any question as to the 
adequacy of their salaries; one-fifth report health problems serious 
enough to be sources of maladjustment. 

13. The intelligence test scores of the men (teachers and prospective 
teachers) are slightly higher than those of the women (teachers or 
students). 

14. The correlations between intelligence scores and adjustment 
scores are so low as to be negligible. 

15. The correlations between the self-estimates of adjustment 
and the adjustment test scores are so low as to indicate that the 
subjects are unable to judge their own mental health. 


SUGGESTIONS FOR FURTHER STUDY 


The investigation reported has left untouched the question as to 
how the teachers’ own adjustment difficulties affect their attitude 
toward their pupils’ problems. The present author hopes to study 
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that question, using as subjects a group of teachers attending summer 
school, and utilizing techniques already developed to measure (a) 
the teachers’ own adjustment and (b) their attitude toward the 
adjustment problems of pupils. A more critical study would necessi- 
tate the investigation during the school year of the mental health 
of a group of teachers in service and the coincident investigation of the 
mental health of the pupils being taught by these teachers. 
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A MEASURE OF THE SINGING AND RHYTHMIC 
DEVELOPMENT OF PRESCHOOL CHILDREN! 


SERAPHINE 8. SELTZER 
The Merrill-Palmer School 


The purpose of this study was to devise a measure, simple to under- 
stand and use, with which the musical development of preschool 
children, specifically, their singing and rhythmic development, could 
be evaluated. 

Seashore’s measures of musical talent? and the Kwalwasser-Ruch 
tests of musical accomplishment? are too involved and difficult for use 
with young children. Various studies‘ of the musical ability of young 





1 Adapted from a study made under the direction of Dr. Rachel Stutsman of the 
Merrill-Palmer School, and accepted by the College of Education, Wayne Univer- 
sity, in partial fulfillment of the requirements for the Master’s degree. The author 
wishes to thank Dr. Stutsman, Miss Leone Chesire, Miss Louise Conklin, Miss 
Jessie Wedin, and Dr. Walter Bergman, all of whom helped in various ways in the 
study. 

2 Seashore, C. E.: The Psychology of Musical Talent. Silver, Burdett & Co., 
1919. 

* Kwalwasser-Ruch: Test of Musical Accomplishment. Extension Division, 
University of Iowa, 1924. Information tests by which children are graded on their 
musical information. 

* Vance, T. F. and Grandprey, M. B.: ‘‘Objective Methods of Ranking Nursery 
School Children on Certain Aspects of Musical Capacity.”” Journal of Edu- 
cational Psychology, Vol. XXII, November, 1931, pp. 577-585. Ratings of chil- 
dren on seven items, including response to music under different circumstances, 
beating time to phonograph records, imitating teachers in beating rhythmical 
patterns on the triangle, and musical environments in the home. 

McGinnis, Esther: ‘‘Seashore’s Measures of Musical Ability Applied to 
Children of the Preschool Age.’”’ American Journal of Psychology, Vol. XL, 1928, 
pp. 620-623. In this study three of the Seashore tests, of pitch, intensity, and 
consonance, were selected for experiment with preschool children. The results 
showed that these tests cannot be used with young children in their present form, 
but with suitable modification might become valuable research instruments for 
use with young children. 

Williams, H. M., Sievers, C. H., Hattwick, M. S.: Measurement of Musical 
Development. University of Iowa Studies in Child Welfare, Vol. VII, No. 1, 1933. 
A series of studies of which the first presents data on the rhythmic performances 
and vocal control of pitch of preschool children; the second, on an attempt to 
measure the ability of the individual child to tap in response to patterns differing 
in speed and complexity; the third, the pitch inflection in the speech of preschool 
children. These monographs are technical and concerned with the techniques of 
devising scales of measurement, not with educational procedures. 
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children have been made, but none offers a quantitative method of 
evaluating the musical development of young children which will show 
the musical needs and record the rate of musical development of the 
individual child. Certainly the observant teacher of music can dis- 
cover great differences in the musical abilities of his young pupils and 
recognize their needs fairly well without a quantitative method of 
evaluation. However, the teacher of many children soon forgets the 
earlier musical status of the children and finds it difficult to say what 
progress they have made. If records are to be kept, his judgment of 
the ability and progress of the children, in the absence of a rating 
device, is not easily transferred to paper. Moreover, a quantitative 
method of rating the children’s development in music enables the 
teacher to determine which of two methods of instruction will bring 
about the greater rate of progress in the total level of the group. 
Some may object to an attempt to measure ability and progress in 
an art, such as music. However, at the Merrill-Palmer School, where 
the study was made, many useful quantitative measures of the develop- 
ment of young children have been devised, some of them dealing with 
factors which appear just as elusive as the artistic skill of singing and 
rhythmic response. The present study is an attempt to add one more 
device to the means of measuring the different aspects of artistic 
development, and to make more nearly complete the means of record- 
ing the entire development of the child. To the music teacher of young 
children, in particular, the scale is intended to offer a means of deter- 
mining what teaching procedures are most successful, what the child’s 
musical status is, and what progress he makes under instruction. 


SPECIAL REQUIREMENTS OF A SCALE MEASURING MUSICAL 
DEVELOPMENT 


In general, tests evaluating the abilities of young children measure 
their performance in controlled situations. Musical development 
might be measured in this way. However, such a measurement 
requires standards of achievement, and without elaborate procedures 
would be subjective, offering no more real quantitative information 
than a rating, despite a complex set-up. Moreover, in such a situation 
the group influence, the spontaneity of the child, and his lack of self- 
consciousness when expressing himself in a less controlled situation 
would be lost. It is desirable also that the child’s response to music 
be tested in many situations, not a single one, before a decision is made 
concerning his ability or attainment. 
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The most suitable way of studying the child’s musical development 
seems to be to observe his progress from day to day and to record it by 


means of a rating device defining the type of observation in concrete 
situations. 


DEVISING THE SCALES 


Since no earlier scale existed as a pattern to follow or deviate from, 
it Was necessary to experiment with methods devised to evaluate other 
aspects of development. The method of evaluating aspects of per- 
sonality in young children, devised at the School, appeared to lend 
itself to the measurement of musical development. This method is an 
adaptation of that described by Thurstone in his Measurement of 
Attitude! Thurstone explains the method as an attempt to represent 
the distribution of a group on a specific issue in the form of a frequency 
distribution, represented by a linear continuum, extending from 
extreme lack of development, or absence of the attitude being meas- 
ured, to extreme development. In the present scale, the positions in 
the continuum of particular statements concerning singing develop- 
ment or rhythmic response were determined by qualified judges. The 
progress of the preschool child to be measured is determined by check- 
ing the statements descriptive of his degree of development, and the 
mean score of the statements checked represents his general musical 
development. 

The most exacting task in formulating the scale was the setting up 
of two lists of statements, one dealing with singing development, 
another with rhythmic ability. These were formulated on the basis of 
the music program with the Merrill-Palmer nursery-school children and 
from other available methods and materials used in the musical educa- 
tion of young children. These statements were evaluated and revised, 
and many of them discarded. The judges were asked to number the 
statements from one to eleven, on the basis of whether they represented, 
at one, the greatest possible lack of progress in singing or rhythmic 
development, or, at eleven, the greatest possible development, or some 
point between, with the midpoint at six. In singing development, 
statements concerned not only the child’s singing, but also his response 
to music sung to him and appreciation of music during the singing 
period in the nursery school. In rhythmic development, the state- 





1 Thurstone, L. L. and Chave, E. J.: The Measurement of Attitude. University 
of Chicago Press, 1929. 
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ments concerned rhythmic activities expressed through the child’s 
body as well as performance on percussion band instruments. 

The original lists of statements were evaluated by a total of ninety- 
seven judges, in four groups. Ideally all these judges should have been 
persons experienced in music at the preschool level, but, since it was 
not possible to secure sufficient judges with these qualifications, the 
nearest approximation was made in securing the assistance of three 
groups of teachers and students associated with Detroit Teachers 
College. Some of these were students with special training in music. 
The greater number of the judges had had experience in teaching 
music in the grades and were at the time registered in music courses. 
The fourth group of judges, from the Merrill-Palmer School, comprised 
five women who had had experience in music for young children. 

The returned statements were tabulated to show the opinion of 
each judge on each statement, the cumulative frequency of each state- 
ment was determined, and a percentile ogive curve drawn on the basis 
of the results. The cumulative frequencies of each statement were 
plotted on a graph in order to determine both the scale and ambiguity 
values of the statement. The scale value of each statement is the 
point where the curve passes the fifty per cent level, z.e., the median, 
and the ambiguity value is determined by finding the difference 
between the values of the points where the curve crosses the seventy- 
fifth and twenty-fifth per cent levels. The final statements were 
selected from the original list by the criteria of least ambiguity, greatest 
relevance, clear-cut scale value, failure to duplicate other statements, 
and, in case of difficulty, by a final checking of the ratings with those 
of the five judges who had experience of music for preschool children. 
On the basis of these criteria the final scales, shown in the following 
pages, were arrived at. The final rating scale of singing development 
includes forty-two statements, selected from an original list of ninety- 
eight, and the final scale of rhythmic development forty-four state- 
ments, selected from an original ninety-four.! 

The number in parenthesis before each statement is the scale value 
of the statement. This rating key is placed beside the statements 
only after they have been checked for the individual child. Only 
those statements true of the child being rated are checked. The sum 
of the scale values of the statements checked, divided by the number 
of statements checked, gives the score of the child rated. 





1The manuscript of the original study, describing in detail the process of 
devising the scales, may be borrowed from the Merrill-Palmer School. 
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When a sufficient number of children have been rated on the scale, 
a percentile table can be derived from the results and the score of an 
individual child can then be interpreted in terms of percentile rank.! 
MERRILL-PALMER SCHOOL 
Progress in Singing Development 
Date 





Name Rated by 
Directions for Rating: 








Check only those statements which you feel are really true of the child. 


Do not guess if you are not reasonably sure. A few true statements are 
better than many half true ones. 


ScaLe VALUE 


9 1. ( ) Recognizes a song upon hearing the opening phrase. 

6 2.( ) Recognizes a song after hearing it played through once. 

1 3.( ) Does not recognize a song (previously taught). 
10 4.( ) Matches a single tone accurately at first attempt. 

6 5. ( ) Matches a single tone accurately after several attempts. 

2 6. ( ) Cannot match a single tone with any accuracy of pitch. 
10 7. ( ) Matches a series of simple tone combinations accurately (at 


first attempt). 
7 8. ( ) Matches a series of simple tone combinations accurately after 
several attempts. 
6 9. ( ) Matches a series of simple tone combinations so that a close 
resemblance is apparent. 
3 10. ( ) Cannot match a series of simple tone combinations. 
10 11. ( ) Matches a series of long and difficult tone combinations at 
first attempt. 
7 12. ( ) Matches a series of long and difficult tone combinations so that 
a close resemblance is apparent. 
8 13. ( ) Recognizes when the flow of the melody is upward. 
3 14. ( ) Does not recognize when the flow of the melody is downwards. 


10 15. ( ) Imitates accurately the calls of things about him (bells, birds, 
' etc.). 
3 16.( ) Makes no attempt to imitate the calls of things about him. 
8 17. ( ) Likes to sing songs taught him. 
3 18. ( ) Does not like to sing songs taught him. 
8 19. ( ) Sings spontaneously as he works or plays. 
4 20. ( ) Does not sing as he works or plays. 
2 21. ( ) Tries to avoid singing. 





1Sample copies of the scales are available from the Merrill-Palmer School, 
71 East Ferry Avenue, Detroit, Michigan, at five cents each. 
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8 22. ( ) Sings with a pleasing quality of voice. 
4 23. ( ) Sings with a harsh quality of voice. 
2 24. ( ) Sings in a monotonous drawl. 
2 25. ( ) Mumbles when he is asked to sing. 
9 26. ( ) Is critical of his own singing. 
5 27. ( ) Is not critical of his own singing. 
10 28. ( ) Creates songs with original words and original melody. 
9 29. ( ) Can put a phrase or sentence to music. 
5 30. ( ) Does not create songs. 
4 31. ( ) Does not ask to have music sung or played for him. 
8 32. ( ) Asks to have music sung or played that he has heard before. 
7 33. ( ) Sometimes expresses the mood of the music in his singing. 
8 34. ( ) Recognizes the difference between loud and soft. 
5 35. ( ) Sometimes recognizes the difference between loud and soft. 
2 36. ( ) Never recognizes the difference between loud and soft. 
9 37. ( ) Recognizes the differences between sad and gay. 
6 38. (. ) Sometimes recognizes the differences between sad and gay. 
3 39. ( ) Never recognizes the difference between sad and gay. 
10 40. ( ) Plays little original tunes on an instrument such as water 
glasses, xylaphone or piano. 
5 41. ( ) Not interested in playing tunes on water glass, xylaphone, 
piano, etc. 
4 42. ( ) Indifferent to music period. 
MERRILL-PALMER SCHOOL 
Development in Rhythmic Ability 
Date 
Name Rated by 





Directions for Ratings: 


Check only those statements which you feel are really true of the child. 


Do not guess if you are not reasonably sure. A few true statements are 
better than many half true ones. 


ScaLE Va 
.. & 
2 2. ( 
4 3. ( 
9 4. ( 
4 5. ( 
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Marches to music played in march time. ] 
Makes no response to music played in march time. 

Performs some other rhythmic activity to music played in 

march time. 

Recognizes march time when a new march is substituted for 

one previously taught. - 

Does not recognize march time when a new march is substituted 

for one previously taught. 
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Can continue rhythm after slight confusion when a new march 
is substituted for one previously taught. 

Runs in response to music for running activity. 

Makes no response to music for running activity. 

Performs some other rhythmic activity to music for running 
activity. 

Recovers rhythm after slight confusion when a new piece of 
music for running activity is substituted for one previously 
taught. 

Cannot recover rhythm lost in changing to a new piece of 
music for running activity. 

Immediately recognizes that the music is a running activity 
when a new piece of music is substituted for one previously 
taught. 

Skips to music for skipping activity. 

Makes no response to music for skipping activity. 
Immediately recognizes music for skipping when a new piece 
of music is substituted for one previously taught. 

Becomes confused when a new piece of music for skipping is 
substituted for another previously taught. 

Performs the correct rhythmic activity when he hears the entire 
piece of music previously taught. 

Always performs the correct rhythmic activity for music 
previously taught. 

Usually performs the correct rhythmic activity for music 
previously taught. 

Seldom performs the correct rhythmic activity for music 
previously taught. 

Never performs the correct rhythmic activity for music previ- 
ously taught. 

Makes no attempt to respond rhythmically to music previously 
taught. 

Responds to music which he has not heard before by tapping 
or clapping. 

Makes no response rhythmically to music which he has not 
heard before. 

Expresses his own ideas of music through creative responses. 
Has to know the name of the music before he can perform the 
rhythmic activity. 

Cannot perform the correct rhythmic activity even when told 
the name of the music. 

Performs the correct rhythmic activity as soon as other children 
lead the way. 

Becomes confused when there is a change in rhythm. 
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Recovers the rhythmic activity after becoming confused by a 


change of rhythm in the music. 

Recognizes similarity of rhythmic patterns in different pieces 
of music. 

Can express through rhythmic activity contrasts in intensity 
of sounds. 

Cannot express through rhythmic activity contrasts in intensity 
of sounds. 

Can express through rhythmic activity different note values. 
Interprets the mood of the music fairly well. 

Requests music to express his own rhythmic activities. 

States definitely the kind of music he wants to express his own 
activities. 

Likes to play rhythms on percussion instruments. 

Has no desire to play rhythms on percussion instruments. 
Plays rhythmic patterns on instrument so that it coincides 
with patterns of music played. 

Sometimes plays rhythmic patterns on instrument so that it 
coincides with patterns of music played. 

Creates new rhythmic patterns on percussion instrument. 
Never creates new rhythmic patterns on percussion instrument. 
Has greater interest in the mechanical aspects of the instru- 
ment than in the music. 
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AN UNEMPHASIZED FACTOR IN CURRENT THEORIES 
REGARDING THE TRANSFER OF TRAINING 


ERNEST E. BAYLES 


Associate Professor of Education, University of Kansas 


The title of this paper states fairly the writer’s intention. There 
is no thought of presenting a new theory regarding transfer of training, 
nor even of presenting new data. Our only purpose is to assist in 
emphasizing what appears to be, until recently, an unemphasized and 
almost unrecognized factor in transfer. This factor seems to be 
sufficiently important for teaching theory that a considerable amount 
of attention will not be amiss. 

Only a brief sketch of past and current interpretations of transfer 
is necessary here. First is the theory of faculties, in which transfer is 
assumed to be well-nigh complete. Formal discipline has never 
recovered from Thorndike and Woodworth’s experimentation at the 
turn of the century. If a faculty were to possess the traits it was sup- 
posed to possess, improvement in function must be as large in one field 
asinanother. When this hypothesis was put to the crucial test, nature 
gave a negative answer. ‘Transfer did not even approach one hundred 
per cent. 

As we see it now, the difficulty with the faculty theory was that it 
assumed transfer to be automatic; dependent entirely upon conditions 
posed by the environment. Whenever, the environment established a 
condition conducive to transfer, the properly trained individual, 
according to the theory, was supposed to take advantage of it and 
act accordingly. If the individual had become good at reasoning or 
observing, he would reason or observe well, supposedly, every time the 
situation was such as to call for reasoning or observation. Both 
experience and experiment combine to prove that such an outcome is 
never achieved. Education would be far simpler in many ways if 
such an hypothesis would only work. 

In order to replace the faculty theory, Thorndike proposed the 
theory of “identical elements.” Training would transfer when, only 
when, and in the degree to which, previously learned elements appeared 
in later situations. This is the reflex arc or S-R bond concept. But 
here again is a notion of automatic transfer; a notion that the indi- 
vidual will transfer his training whenever the environment establishes 
a favorable set of conditions. After all, such a theory is fundamentally 


the same as the faculty theory, for all one needs to do is to divide 
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faculties into sufficiently small units, and behold, one will have identical 
elements. If transfer does not occur whenever the environment sets 
the stage (that is, whenever a proper stimulus is applied) then the 
theory breaks down. And it can be, and has been, easily demon- 
strated that identical elements do not achieve one hundred per cent 
transfer. : 

One might argue that the difficulty lies in the fact that we have not 
yet found the true elements. This may well be, but the search for true 
elements has been followed persistently for many years and it seems to 
be getting nowhere. Moreover, physicists and chemists have virtually 
abandoned the hope of finding ultimate elements, and it may be wise 
for psychologists to do likewise. 

Between 1915 and 1920 the argument waxed hot between Thorndike 
and Judd as to whether transfer was to be obtained through the agency 
of identical elements or of generalizations. Judd’s dart-throwing 
experiment seemed to show that identical elements in the environment 
were not enough. It appeared to show the advantages of a ‘“‘general- 
ized’”’ training; that is, an individual must have been shown during 
his training that situations seem to work according to discoverable 
rules, and that one must become able to apply the rule (or generaliza- 
tion) before one can take advantage of environmental recurrences and 
use one’s training profitably. 

It would seem that the generalization-of-experience theory has 
some advantage over the identical-elements theory. Long since have 
Thorndike’s pupils reported that he admits the advantage of awareness 
on the part of the individual of the possibility of transfer. If the 
individual approaches a new situation with the idea that he may be 
able to apply ideas, rules, or generalizations previously learned, he will 
be more likely to interpret the new as being similar to the old, and act 
accordingly, than if he does not so approach it. This, as I see it, is 
what training in generalization tends to promote, but does not empha- 
size sufficiently. The question, whether or not transfer will always 
occur after the individual has learned a given principle or generaliza- 
tion, still seems to be answerable only in the negative. 4 

I believe it just as futile to expect a generalization to spring into 
action whenever the environment sets the stage as to expect such of a 
faculty or of an “identical element.’’ The difficulty is that the theory 


of transfer-by-generalizations still leaves the emphasis upon the 


environment as the dominant motivating agency; it still interprets 
transfer as being automatic when the environment sets the stage. 
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Transfer of a given principle will not be one hundred per cent even 
when the individual understands the principle thoroughly and has 
applied it often. For example, an object will float in water if its specific 
gravity is less than the specific gravity of water. This is a phase of 
Archimedes’ principle, and is well understood by many general science 
and physics students. But how many will recognize, without being 
told, that Archimedes’ principle applies equally well to objects floating 
in liquids other than water, and to objects floating in air? How many 
students will solve correctly problems dealing with flotation in air after 
having received instruction on flotation in water? Not a large propor- 
tion; certainly not one hundred per cent. Some will catch the relation- 
ship immediately; others will see it if given a bare hint; others, if the 
similarity is carefully explained; and possibly others, not at all. 
Evidently something more than commonness of elements or appro- 
priateness of generalizations is necessary in order to make transfer 
dependable. In so far as this ‘“‘something”’ is missed, the transfer-by- 
generalizations theory is little better than the identical-elements or 
even the faculty theory. 

If I were limited to a choice among the three, I would choose the 
generalizations theory, for it demands more specific training than does 
the theory of faculties, and is at the same time broader and more 
educative than the theory of identical elements. But since a general- 
ization may be the identical element in question, the principle of 
transfer is the same in both cases. This similarity has been noted by 
Sandiford, a pupil of Thorndike, who claims that both theories amount 
to one and the same thing. Orata, whose analysis of the literature on 
transfer of training is probably as thorough and as sound as any in 
existence, makes the following statement: 


The problem .. . is the ability not so much to generalize and apply as 
to deal with changing ideals and standards, which means the ability and 
willingness to change the generalizations made previously. . . . This ability 
to deal with changing principles or generalizations Judd’s theory does not 
provide for, much less does Thorndike’s theory of identical elements.! 


' As a result of Orata’s summary of all studies of transfer made 
between 1890 and 1935, he concludes that, 


Forty-seven or nearly thirty per cent show considerable transfer, eighty 
or nearly fifty per cent show appreciable transfer, fifteen or less than ten per 
cent show little transfer, six or less than four per cent show no transfer, and 





1 Ed. Adm. & Superv., Vol. XXI, No. 4, 256. 
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the rest which comprise less than ten per cent show both transfer and inter- 
ference. And since interference is indicative of transfer of a negative charac- 
ter, it is safe to conclude that all doubts with reference to the possibilities of 
transfer of training may be cast away.' 


But while Orata concludes that ‘‘the fact of transfer can no longer 
be doubted,” he also concludes (in the same sentence) that ‘‘it is not 
an automatic process.”’ (p. 252) 

Now, since all of the current theories which appear to assume that 
transfer will always occur whenever a particular kind of environment 
impinges upon a particularly trained individual fail to dispose of the 
problem satisfactorily, what then? What is the rest of the story? 
What essential feature of the picture has been omitted? 

Bagley seems to hit close to the mark when he introduces the 
concept of the ‘‘conscious ideal.’”’ He found little transfer of the 
‘‘ideal”’ of neatness from class A to other classes, when the ideal was 
applied to-class A papers only. But he found considerable transfer 
after the teacher of class A had dwelt upon the desirability of neatness 
papers prepared for classes other than class A. I have heard Judd 
speak of the necessity of teaching not only the generalization in ques- 
tion, but also of teaching pupils at the same time that opportunities for 
applying the generalization will probably be met frequently and 
that they will do well to look for such opportunities. Thorndike 
and Gates go on record as follows: 


Studies of the transfer of training also have shown that the methods used 
in guiding the pupils’ learning activities have marked effect upon the degree 
of transfer. The more clearly the crucial element or fact or principle in a 
situation is brought to the pupil’s attention the more readily the same element 
or fact or principle may be identified in another situation. . . . If a child 
observes, despite many differences in details in a new mechanical puzzle, 
that the vital principle is the same as in puzzles previously solved, the solution 
is more likely to be achieved than when the common principle is not identified.* 


The following quotation is from Mursell: 


Our general comment on this (the identical-elements) theory is that identi- 
cal elements between two situations must always be identities which exist in 
the learner’s mind. The mere fact that certain English words are derived from 
Latin will not guarantee transfer, and indeed will not produce it in any way, 
unless the identity is perceived and responded to by the pupil. And this 





1 Ibid., pp. 242-243. 
2 Elementary Principles of Education, p. 104; quoted by Orata, Ibid., p. 245. 
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absolutely essential recognition, perception, and reaction to identities in 
various situations, is not a passive affair, which can be counted on to occur.! 


| The point seems to be that individuals must become to a degree 
conscious or aware of common factors in differing situations—be they 
elements, generalizations, rules, ideals, meanings, or what. They 
must comprehend the elements as common, the generalizations as 
applicable, or the meanings as appropriate. They must, somehow 
or other, sense the similarities between later and earlier experiences. ) | 

||But does this sensing of similarities or relationships need always 
to be on the level of clear and full consciousness? Apparently not; 
because many times we act upon the basis of a vaguely felt hunch— 
intuitively—without being able to state clearly our reasons for so 
acting. Let me suggest that) it seems probable that we transfer 
previous learning whenever and wherever we sense a later experience 
as being similar, more or less completely, to an earlier one. This 
‘sensing of similarities or relationships’? may be vague, or it may 
reach the level of fully conscious understanding. The more clearly 
or fully the relationships are sensed or recognized the greater 
is the likelihood of transfer. And conversely, the less clearly or fully 
the similarities or relationships are recognized, the less is the likelihood 
of transfer. It is not enough that the environment set the stage for 
recognition; the individual is active as well, and the nature of his 
activity—of his goals and his insights—will be the deciding factor in 
determining whether or not he will take advantage of the opportunity 
offered by what confronts him.) 

Finally, may I point briefly to what this modified view may mean 
for teaching. If we want our in-school teaching to transfer in the 
greatest possible degree to out-of-school behavior, it behooves us to 
make the student acutely aware of the possibilities of transfer. We 
must bring him, as frequently as possible, to see the relationships 
between in-school and out-of-school situations. In having such 
relationships repeatedly brought to his attention, the student will 
become progressively more sensitive to the existence of common or 
universal features in behavior, more aware of the possibilities of dis- 
covering and using such relationships, more likely to discover and 
apply them for himself, and thus more apt to transfer previous training 
into new areas of experience. If we would have training transfer in 
high degree, we must make the student acutely sensitive to the fact 





1 The Psychology of Secondary-School Teaching, pp. 104-105. 
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that every new experience is likely to have much in common with the 
old. He must be brought to realize that rules used with success at 
prior times have likelihood of being successfully used again and again. 
And he must also be brought to see that new problems may also be 
solved by old rules slightly modified if only the right ones can be found. 

One must be able, of course, to see differences as well as similarities; 
else needless mistakes will be made. No two sets of experiences 
are ever exactly alike. Life is forever new. Training which will 
enable one to meet life adequately—that is, training which will transfer 
—is merely training in being intelligent . . . thoughtful . . . scien- 
tifically-minded. 

If we would make training transfer, our teaching must accomplish 
two objectives more or less simultaneously: First, it must bring the 
student to understand as many widely useful relationships, principles, 
or generalizations as possible; second, it must whet the student’s 
realization-that his previous training has wide possibilities for transfer, 
but that transfer is never automatic. It must bring a realization that 
transfer comes only if and when one senses for one’s self that transfer 
is possible. One becomes able to make the greatest transfer of previ- 
ous training when, and only when, as a matter of habit, one is on the 
alert to recognize previous relationships, principles, meanings, or 
generalizations which may be used in the new situations that are 
always at hand. 
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NOTE ON A GRAPHIC METHOD FOR DETERMINING 
THE SIGNIFICANCE OF THE DIFFERENCE 
BETWEEN GROUP FREQUENCIES 


JOSEPH ZUBIN 
College of the City of New York 


In statistical investigations in education, psychology, economics, 
and public health, it sometimes becomes necessary to compare the 
incidence of many factors in two distinct groups. Examples of such 
comparisons are (1) the validation of items of a test, (2) the comparison 
of the rates for various diseases in two communities, (3) the compari- 
son of the types of expenditures in two different income groups, (4) the 
comparison of ‘‘passes”’ and ‘‘failures”’ on a series of tests for ‘‘good”’ 
and ‘‘poor” readers or for “successful” and ‘“‘failing’”’ salesmen. 
Ordinarily a considerable amount of computation is involved in these 
comparisons. The purpose of this paper is to provide a graphic 
scheme which will obviate the need for any computations. The 
absolute frequencies will be compared directly and the significance 
of the difference determined by mere inspection. The method will 
be illustrated by an application to item analysis. 

The usual procedure for selecting the items of a test that differenti- 
ate significantly between two discrete groups may be described as 
follows: The responses of all the individuals to each of the items are 
tabulated and the incidence of each response in the two discrete groups 
is compared. For example, if the two groups under comparison are a 
group of normal individuals and a group of abnormal individuals, 
their responses will be tabulated as in Table I. 


TABLE I.—INcCIDENCE OF NORMAL AND ABNORMAL RESPONSES TO ITEM 1 




















Yes No Total 
ti a! 1 Poth a AR a b (a + b) 
I og kos £02 cal chee eeee nes c d (c + d) 
EEN re ee eet a eee eee (a+c).| (6+ 4d) N 





In Table I a is the number of normalardividuals who responded 
Yes to item 1, b is the number of normal individuals who responded No, 
¢ is the number of abnormal individuals who responded Yes, and d is 
the number of abnormal individuals who responded No. The usual 
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procedure in determining whether the two groups differ in their 
responses to item 1 is to compare the proportion of normals who 
responded Yes, a/(a + b), with the proportion of abnormals who 
responded Yes, c/(c +d). The difference between these two pro- 
portions is then compared with its standard error to determine its 
statistical reliability. The critical ratio, C;, for this comparison can 
be written: 


= 
- (a+b) (c+d) 

R ab 4 cd 
(a+b)* (c+d)? 


This is usually written in percentages or proportions and appears in 
the familiar form as equation (2). 








C , (1) 














ihe ZS PS (2) 
Nit N: 
where 
a b 
M= Gt"  @FD) 


2 Cc a d 
P2 = (+d) S"Gere 
N; = (a+b) Nez = (c+ d) 


The hypothesis underlying this comparison is that the normal 
individuals do not differ from the abnormal individuals in their response 
to the item in question. From the point of view of the item, the 
normal and abnormal groups are tentatively regarded as two samples 
drawn from the same population. If the critical ratio of the difference 
between the incidence of the Yes response in the two samples is low, 
that is, if it is no larger than the value that could arise by chance 
between five and ninety-five times in one hundred, the hypothesis 
that normals do not differ from the abnormals in their Yes response to 
this item is tenable. If, on the other hand, the critical ratio turns out 
to be large, (so large that it could arise by chance less than five times 
in one hundred) the tentative hypothesis that the two groups are 
samples of the same population is rejected. In this case the response 
is considered to differentiate between the two groups. 
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Under the hypothesis that the two samples are drawn from the 
same population, the best estimate of p, the proportion of Yes responses 
in the population, is the weighted average of p: and po, which will 
be designated as p’ = [Nip; + Nopeo]/N. The standard error of 
D1, oP: = Vp’q'/Ni, the standard error of po, op2 = ~/p’q’/Nz and 
the standard error of the difference is 

_ |paN 
o(p; D2) _ NN; 





and 





aie [pi — po)! _ iN>2 VAN 
ae a» pal oan 


Resolving this formula to the absolute frequency form, it becomes: 


, (ad — be)\/N 
“V (a + b)(c + d)(a + c)(b + d) 


The value of C obtained in this manner is equal to ¢?N where ¢? is the 
square of the Boas-Yulean ¢ which is the four-fold point correlation 
coefficient. If we square C2 in equation (3) we obtain 


(ad — bc)?N (4) 
~ [a+ b)(e + da)(a +c)(6 + 4)] 


Equation (4) is the expression for Chi square. We shall henceforth 
replace C,? by Chi square. 

The value of C2 given by equation (4) is not identical with that of 
C, given by equation (2). But it has been demonstrated that C2 is 
identical with x?, and the value of x? is the best approximation that 
is now available for the determination of the exact probability of the 
difference between frequencies. Hence C2 is to be preferred to C,, 
despite the fact that C; has a greater vogue in educational and psycho- 
logical work. The advantage of the newer method results from the 
fact thdt ’p’, the population value of p’, can be estimated with greater 
exactness from the data than either ’p; or po, the two population values 
corresponding to p; and ps2, because ’p’ is estimated from a larger 
sample. The value of C2 may be interpreted in terms of the proba- 
bility table for deviations from the mean in a unit normal distribution, 








C; = 


(3) 


C,? 








1Yule, G. U.: An introduction to the theory of statistics. London: Charles 
Griffin and Co., 1927, Eighth Edition, p. 217, formula (12). 
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or in terms of Chi square with one degree of freedom by means of the 
table provided by Fisher.! 


COMPUTATION OF Czy AND CHI SQUARE 


When only a few comparisons are to be made the significance of the 
difference can be obtained most readily by the use of the Edgerton- 
Paterson Tables,? or by the use of the Transformation Function 
provided by the present writer.* Both of these methods require 
that the obtained frequencies be converted into proportions or percent- 
ages before the comparison can be made. When a very large number 
of comparisons are to be made between the incidence of responses in 
two groups, the method to be described in this paper offers a consider- 
able saving of time. The first advantage of the new method results 
from the fact that the frequencies can be compared directly and do 
not have to be converted into proportions. The second advantage 
of the new method results from the fact that it eliminates the computa- 
tion of standard errors and critical ratios. 

Usually the exact value of Chi square is not the end sought in 
the analysis. More often, the only information required is whether 
the value of Chi square falls above or below the critical value required 
for statistical reliability, (6.635 for 2 X 2 fold tables with one degree 
of freedom).* In order to determine whether a given combination 
of values of a and c in Table I yields a significant value of Chi square, 
we need to know the critical values of c associated with a given value 
of a. We wish to know how much c must excel or fall below a in order 
to produce a statistically significant difference. It can be readily 





1 Fisher, R. A.: Statistical Method for Research Workers. Edinburgh: Oliver 
Boyd, 1934, Fifth Edition, p. 89. 

The relationship between C, and Chi Square is given in Fisher, R. A.: ‘‘On 
the Interpretation of x? from Contingency Tables and the Calculation of P.” 
Jr. Royal Statistical Soc., 1922, p. 91. It is also given in the lecture notes of 
Harold Hotelling, and has also recently appeared in Irwin, J. O.: ‘Tests of signi- 
ficance for differences between percentages based on small numbers,’”’ Metron, 
Vol. XII, 1935, pp. 83-94. 

2 Edgerton, Harold A. and Paterson, Donald G.: ‘‘Table of Standard Errors 
and Probable Errors of Percentages for Varying Number of Cases.” Jr. Applied 
Psychology, Vol. X, No. 3, Sept., 1926, pp. 378-391. 

’ Zubin, J.: ‘A Transformation Function for Proportions and Percentages.”’ 
Jr. Applied Psychology, Vol. XIX, No. 2, pp. 213-220. 

‘It has become customary in psychological and educational investigations to 
take P = .01, as the critical value of the probability rather than P = .05 as 
suggested by Fisher. 
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shown that the locus of these critical values of ¢ and a is an ellipse. 
After simplifying equation (4) and remembering that Chi square can 
be replaced by N . ¢?, we obtain equation (5) 


a*(g? + r)r + 2ac(¢? — 1)r — c?(rg? + 1) — (a+c)rN¢*=0. (5) 
W here 


» = +6). 
(c + d) 


Equation (5) is the equation of an ellipse in variablesaandc. The 
other terms in equation (5) are constants. The value of ¢? is a con- 
stant as long as Chi square is kept constant at the minimum level of 
significance and N remains unchanged. The value of r also remains 
constant as long as the frequencies in the two criterion groups, (a + b) 
and (c +d) remain constant. Equation (5) can be reduced to the 
standard form for the ellipse by two transformations. First, the center 
of coérdinates has to be moved to the point (a + b)/2, (c + d)/2, in 
order to remove the first degree terms. Then the axes must be rotated 


2r(1 — ¢”). 
through an angle @ = 5 tan™' (I—?r im order to remove the cross 





product term. After these transformations are carried out, equa- 
tion (5) becomes equation (6). 


2(n —m Y?-2(n + m) - 


an age Nt t 7g? NTH 1 








0. (6) 


Where X? and Y? are the new variables and n = 1 + r? + 2rq¢’?; 
m= +V/(1 — 7)? + 4r°(1 — 9”)? 
and ¢’? is the critical value of ¢? corresponding to a x? of 6.635.! 
Equation (6) is the equation of an ellipse whose center is at (a + b)/2, 
(c + d)/2 and whose major axis makes an angle of @ with the a axis. 
The length of the major axis of this ellipse is k’ = W2rN29’2/(n — m). 
The length of the minor axis is k” = Q2rN29'2/(n +m). After 
drawing the ellipse according to the above specifications, the area 


bounded by the circumference of the ellipse contains all the points 
whose codrdinates give rise to values of Chi square that fall below the 














‘Only the positive value of m needs to be considered. The negative value 
leads to an ellipse that is identical with the ellipse resulting from the negative 
value of m, except for the interchanging of the ordinates and abcissae. 
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critical value. The area outside of the ellipse contains all the points 
whose codrdinates give rise to values of Chi square that exceed the 
critical value. The points on the circumference of the ellipse are the 
critical points sought. Regarding a as the independent variable there 
will be two values of c corresponding to any given value of a lying on 
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the ellipse. These are the two critical values of c, the minimal and the 
maximal, associated with the given value of a necessary to yield a 
value of Chi square above the critical value. 

Similar ellipses could be drawn for values of x? other than the 
critical value of 6.635. All of these ellipses will be concentric and 
coaxial. They will differ in the lengths of their respective major and 
minor axes. If all of the ellipses corresponding to the various signifi- 
cant probability levels of x? are drawn, the level of probability of the 
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difference for any combination of values of a and ¢ canbe determined 
directly from the graph. 

An example of the application of this method will be given for the 
condition, N = 100, (a + b) = 50. This is the situation when the fre- 
quency in the normal and abnormal groups described above are each 
equal to 50. For this case, r = 1, m = 2(1 — ¢’”), n = 2(1 + 97), 
n—m=4¢?, m+n=4. The angle @ through which the ellipse 
must be turned is 45°. The length of the major axis, k’ is 2(35.355) 
and the length of the minor axis k”’ is 2(9.109). The distance between 
the two foci of the ellipse and the center of the ellipse, k’’’, is +34.165, 


since 4k’" = V6 WVk’2 — k’’?, The center of the ellipse is at the 
point 25, 25. We now have all the data required for drawing the 
ellipse. Table II has been prepared from the ellipse by reading off 
all the values of a and c that lie on the ellipse. Graph I shows the 
ellipse and the two critical values of c that correspond to the value 
of a = 30. The dotted vertical line at a = 30 cuts the ellipse at 
points c = 17 and 41. Hence when a = 30, c must be 17 or less, or 
41 or more, in order to yield a significant difference. 

A simple method for drawing the ellipse is to locate its center 
on a sheet of codrdinate paper at the point P whose codrdinates are 
(a + b)/2, (c + d)/2. At this point draw a line at an angle @ to the 
horizontal axis, a. This line is the line of the major axis of the ellipse. 
Erect a perpendicular to the line of the major axis at the center of 
the ellipse. On this perpendicular lay off the distances +k’’/2, the 
length of the semi-minor axis. On the line of the major axis lay 
off the distances of +k’/2, the length of the semi-major axis. Also 
lay off the major axis the distances +k’’’/2, the distances of the two 
foci from the center. Place thumb-tacks at the top of the minor axis, 
and at the two foci. Draw a string around these three points as 
verteces. Wind a pencil or a stylus through a loop in this string and 
twist it until the proper tautness is attained. Remove the thumb 
tack from the point at the top of the minor axis and run a pencil 
tautly along the string. The pencil will describe the desired ellipse. 
Make sure that this ellipse passes through the ends of the major and 
minor axes. If it does not, the length of the string must be changed 
until the curve passes through these points. 

A still further consideration of equation (4) yields the condition 
under which (ar — c) always yields a value of Chi square that exceeds 
the critical criterion. Equation (4) can be rewritten as follows: 








(ar — c) = VNrx?p"q" (4’) 
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where 
1 
(a + c) (b + d) " " / 
Oe ses vt _ =_ 
Now the maximum value that p’’q’’ can attain is }4. li 


TaBLeE II.—CriTIcAL VALUES FOR THE COMPARISON OF FREQUENCIES IN Two 


























Groups oF Firty INDIVIDUALS t 
x Higher Lower Higher Lower s' 
—a y a 
frequency, c’ | frequency, c frequency, c | frequency, c”’ 
0 6 ‘i 26 39 13 
1 9 ds 27 40 14 
2 10 aad 28 40 15 ‘i, 
3 13 " 29 41 16 N 
4 15 3 30 42 17 A 
5 16 7 31 43 18 T 
6 17 oe 32 43 19 = 
7 18 oy 33 44 20 
8 19 1 34 45 21 f 
9 21 1 35 46 22 . 
10 23 1 36 46 23 
11 24 2 37 47 24 
12 25 2 38 47 25 
13 26 3 39 48 26 
14 27 4 40 48 27 
15 28 4 41 49 29 ok 
16 29 5 42 49 30 co 
17 30 6 43 50 31 
18 31 7 44 50 33 be 
19 32 7 45 p 34 te 
20 33 8 46 a 35 
21 34 9 47 mn 37 ve 
22 35 10 48 aa 39 qu 
23 36 10 49 a 40 CO 
24 37 11 50 ‘ 43 tal 
25 38 12 
Hence (ar — c) > 4%~/Nrx?. We can now set x? = x’? the critical 
value of Chi square and determine the value of (ar — c) necessary to — 
produce a Chi square of 6.635 when p’’q’’ = 4%. Whenever (ar — c) No 
exceeds this value, x? exceeds the critical value, and hence the differ- Ab 


ence is significant. The line on which the points that satisfy the 
condition (ar — c) = 4+ /Nryx’? lie, has the slope 1/r and an intercept 
of +14+/NX’?/r and can be readily drawn. 
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For the example described above, (N = 100, r = 1), (a —c) = 
loV/ 100/6.635 = 12.8. Hence whenever (a — c) exceeds 13, the 
difference must be significant. The area in which the points whose 
coérdinates satisfy this condition lie can be determined by drawing a 
line at the point 12.8, 0 with a slope parallel to the major axis, since 
r=1. The area to the right of this line contains the points for which 
the differences are always significant. 

If there are more than two choices to each item, the formula is 
still applicable. Table III shows the results for a three choice item. 




















TaBLeE III 

Yes No ? Total 
I ee ee a b c (a+b+c) 
cinnerak wee smqnnin d e f (d+e+f) 
RE Ag pene oe (a + d) (b + e) (ec +f) N 








In this table we can determine whether a is significantly different 
from d in the following equation. 


x? = (a — d)?N 
~~ [at+bb+ctet+fatb+odt+etf)] 


This value of Chi square is equivalent to the value that would be 
obtained when each response is pitted against the other two responses 
combined.! 

The graphic determination of the significance of the difference 
between frequencies that has been described above has been limited 
to one specific value of N. We can generalize the solution for all 
values of N by dealing with proportional instead of absolute fre- 
quencies. This will necessitate the computations of the proportions 
corresponding to each absolute frequency in the various 2 X 2-fold 
tables to ‘be examined. But once these proportions are obtained, 





(7) 

















TABLE IV 
Yes No Total 
4. oa ced clieinn eee bead ewer eens ae Pi P2 Pi + De 
EL, +. or bieddaendsooennatbaee end D3 Pa Ps + De 
Pi + Pa P2 + pM 1.000 








1 Fisher: Op. cit., p. 105. 
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the significance of their difference can be determined from the graph. 
Converting Table I into proportional frequencies we obtain Table IV. 


where 


alo 


2 > 


P2 


3 

_ 

i 
=| 8 


and 


S| a 


ps = 


Equation (6) can be rewritten in terms of the proportional frequencies 
into equation (8) by letting X?/N* = a? and Y?/N? = 8? 


2(n + m) 
rp? 


2(n — 


ro? m) * + 


y-ie® (8) 








and 


al Ni/N ~ Pit P2 
N2o/N pats 


n, m, and ¢? have the same values as before. 





Tr 





rg? 


geen =) The semi- 





The semi-major axis of the ellipse, k’ = J 








, a ro” , : 
minor axis k” = J ata and the center of the ellipse is at the 


+ P2 Pst Ps 
- = 
r 1 

21 +r) 20 +7) 

two parameters, r and ¢?, since n and m are functions of r and ¢? and 
of no other parameters. We can therefore keep r constant and draw 
ellipses for various values of ¢?. These ellipses will correspond to 
various degrees of significance. Thus, the ellipse for ¢? = .10 will 
correspond to a x? of 2.56 when N = 25, or a x? of 5 when N = 50, and 
so on. All of these ellipses belong to the same family, that is, their 
axes differ only in size but not in direction. The drawing of these 
ellipses can be done mechanically by increasing the size of the axes 
step by step in accordance with the increase in the value of ¢?. A new 
system of such ellipses is required for each value of r. Although r can 





point a. In terms of r, the center is located at 





It should be noted that equation (8) has only 
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vary from 0 to 1, it is only necessary to present different values of the 
ellipse for r from .00 to .50, since the ellipses are symmetrical about 
r = .50. If ris taken in steps of .01, it would be necessary to prepare 
fifty such tables. These tables will be exactly accurate when N Z 100, 
and will probably be approximately accurate for larger values. 

A somewhat easier method of providing a generalized solution for 
proportional frequencies is afforded by the ¢ transformation method. ! 
In this method, however, we must deal with percentages based upon 
the frequencies in the two criterion groups. Letting P; = a/N, and 
P, = c/Ne, where N, and N» are the frequencies in the two criterion 
groups, we can transform these values to ¢ values and obtain 


ti — le 














- = C, the critical ratio for the difference. (9) 
VN/N\N2 
Hence 
N 
(ty Pe te) — Slay 
Now 
(t; —_ ts) = 2{sin-! P, — sin! vV P2} 

or 

— N 

cin S/N = VP = PP, - VP = PP 
Let 


~CiwnN » 
sin nee = K. 


By simple algebraic transformation we obtain 
P+ P.2 + (4K? — 2)PiP. — 2K?(P; + P.) + K* = 0. (10) 


Equation (10) can be transformed to the typical equation for an 
ellipse by shifting the center of codrdinates to P; = .50, and P2 = .50 
and by rotating the axes through an angle of 45°. After performing 
these transformations we obtain equation (11) 


xX? re yY2 
2-K?'@-K)  - 
8 8 (—K% 








—1=0 (11) 











1 Zubin: Op. cit. 
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soni 2 


- » the length of the semi- 





The length of the semi-major axis is 














8 
79 — R2\k2 
minor axis is c= i = 7 and the distance between the center and 
+ (2 — K*)(1 — 2K?) 
the two foci is + sl — K% 


The ellipse can now be drawn. The value of K is dependent only 
upon the size of the frequency in the two criterion groups. In order 
to make the results of this graph comparable with those of Graph I, 
we take C = +/6.635 = 2.58 and 


_, 258 | N _. J N 
K = sin 9 vig = sin 1.29 NN,’ 


when N = 100, N; = 50, N2 = 50, K = sin 0.258 = 0.255. 

It should be noted, however, that P; and P2 are expressed in terms 
of N; and Ne, and not in terms of N. Hence, the values of P; and P, 
must be computed anew for each new value of N; and Ne. But it 
seems preferable to follow this method instead of computing the 
fifty charts required by the previous method, equation (8). In the 
present method one chart will be sufficient to cover all the possibilities. 
But this chart must contain ellipses for the different possible values 
of K. All of these ellipses will be concentric and coaxial and can be 
readily drawn. 

Another example of the application of the graphic method for the 
solving of a problem of the significance of the difference between 
frequencies is afforded by the comparison of matched groups. When 
the matching is done by pairs, the results can be analyzed in the 
following manner. Let us suppose that a group of normal individuals 
have been matched with a group of abnormals on several factors. 
The responses of these two groups to a test can be analyzed in accord- 
ance with Table IV. 

This table is read as follows: There were forty-five normal indi- 
viduals who gave the Yes response to the item under analysis, and 
their correspondents the abnormal group also gave the Yes response. 
There were forty-three normal individuals giving the Yes response 
whose correspondents gave the No response, and so on. 

If the normal individuals had given in every case the same response 
that their abnormal correspondents had given, only the long diagonal 
of the table would contain any frequencies. The relationship between 
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the normal and the abnormal groups would be a maximum, and each 
cell would have a value of Chi square that would be far in excess of 
chance. Hence in the selection of items that differentiate between 
the normal and abnormal groups, such an item would be discarded. 
Only the items that give rise to long diagonal cells with values of 
Chi square that fall short of the critical value, would be retained. 
In terms of the graphic solution we are utilizing, we would attempt 
to find the points that lie within the area of the ellipse. In the case of 
the cells that are not in the long diagonal, only those for which the 
value of x? is large indicate differential responses. However, in this 
problem, the marginal frequencies vary from cell to cell, only those 
cells that lie in the same row having the same marginal row frequency. 
That is, the value of r will vary from row to row. In order to be able 
to determine at a glance whether the frequency in a given cell is 
significant or not, it is necessary to prepare graphs of the equation 
of the ellipse for different values of r as described previously, or utilize 
the adaptation of the ¢ method. 




















TABLE IV 
Normals 
Total 
Yes No ? 
ce Sette ssid hal tk tetera d 45 30 33 108 
nN 
BEL | Mowe trtn dr persicae 43 29 28 100 
5 7” 
ES ner eee eee 34 16 21 71 
= 
i is a tat anes erate oe 122 75 82 279 




















Another important use for the graphic solution of the significance 
of the difference between two frequencies is found in connection with 
the computation of the tetrachoric correlation coefficient. The 
computation of these coefficients usually consumes a great amount of 
time, even when the graphs provided by Thurstone! and his co-workers 
are utilized. Very often the correlation coefficient is found to be 
statistically unreliable after the laborious process has been carried out. 
To safeguard against such occurrence, it is advisable to compute 





1Thurstone, L. L., et alia: Computing Diagrams for Tetrachoric Correlation 
Coefficients. University of Chicago Bookstore, April, 1933, pp. 57. 
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the value of Chi square for the table before the computation of the 
tetrachoric correlation coefficient is begun. If the value of Chi square 
indicates a relationship that is statistically reliable, then no matter 
how low the correlation may be, it is still significant. By utilizing 
the graphic method suggested in this paper, the value of Chi square 
for a given table can be determined with very little effort. The 
computation of unreliable coefficients can thus be avoided. 

Furthermore, for some investigations, the Boas-Yulean correlation 
coefficient may replace the tetrachoric correlation coefficient. The 
value of the square of the Boas-Yulean ¢ can be read off from the 
graphs discussed in this paper. After extracting the square root 
of the value obtained from the graph, the sign of the coefficient must 
be determined by inspecting the table. 


SUMMARY 


It has been pointed out that the formula for the critical ratio 
between frequencies that is most often used in psychological and 
educational studies can be replaced by another which has certain 
statistical advantages. The square of the value of the critical ratio 
obtained by the second method is identical with the value of Chi square 
and is equal to N - ¢? where ¢ is the Boas-Yulean correlation coeffi- 
cient. The equation for Chi square in terms of the two frequencies 
under comparison is an ellipse that can be readily drawn. The area 
enclosed within the ellipse contains the points whose codérdinates give 
rise to the values of Chi square that fall below the critical value needed 
for significance. The area outside of the ellipse contains the points 
whose codrdinates give rise to the values of Chi square that exceed 
the critical value. 

This method is applicable to all multiple choice items. When 
the number of choices exceed two, the value of Chi square obtained 
for each choice is equivalent to the value of Chi square that would be 
obtained for each choice when it is pitted against all the other choices 
combined. 
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INFLUENCE OF ORDER OF PRESENTATION OF ITEMS 
IN RANKING 


PERCIVAL M. SYMONDS 
Teachers College, Columbia University 


It has long been recognized that the order of presentation of 
material from which a choice or selection is to be made has been a 
factor in psychological experimentation. The careful investigator in 
a choice or selection experiment will repeat his work altering the order 
of presentation so as to eliminate the influence of this factor. To the 
writer’s knowledge only two studies of this factor have been previously 
made, both by C. O. Mathews.' Mathews found for fourth-, fifth-, 
and sixth-grade pupils that a given answer on a two-response test is 
marked 3.2 per cent more often when it is printed to the left of its 
alternative than when printed to the right, and 33.8 per cent more often 
when it is printed above rather than below. In a second study? 
Mathews discovered that a similar effect was true in a five-response 
interest questionnaire. 

An opportunity to study the strength of the influence of order of 
presentation on choice arose in a study of the problems and interests of 
adolescents in which the data were secured in the form of ranking 
of fifteen printed items. Rankings were secured from two hundred 
twelve boys and two hundred forty-seven girls in the junior and senior 
high schools of Tulsa, Oklahoma,’ and rankings of the same fifteen - 
items presented in reverse order were obtained from one hundred 
sixty-one boys and one hundred ninety-two girls in the same school 
system. Table I shows the distributions of these pupils by grade. 

The fifteen items to be ranked were presented on a single sheet in 
ordinary paragraph form so that each item started directly under its 
predecessor. Directions for ranking asked that the first three in order 
be selected first by writing their numbers in printed boxes on the 
ranking sheet, that the last three in order be selected next, and then 





1 Mathews, C. O.: ‘“‘The Effect of Position of Printed Response Words upon 
Children’s Answers to Questions in Two-Response Types of Tests.’”’ Journal of 
Educational Psychology, Vol. XVIII, 1927, pp. 445-457. 

2 Mathews, C. O.: ‘‘The Effect of the Order of Printed Response Words on an 
Interest Questionnaire.’”’ Journal of Educational Psychology, Vol. XX, 1929, 
pp. 128-134. 


* Through the courtesy of Dr. J. Thomas Wade, Cleveland Junior High School, 
Tulsa, Oklahoma. 
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TABLE I.—DIsTRIBUTION OF PuPpILs BY GRADE 


that the remaining items be ranked in groups of three by writing their 
numbers in their respective boxes. 











When items were presented | When items were presented 
in original order in reverse order 
Grade 
Boys Girls Boys Girls 

7 15 19 18 15 
8 32 33 28 39 
9 64 69 66 66 
10 32 53 17 27 
11 37 34 11 24 
12 30 35 15 15 

Post graduate.......... 1 2 
Not stated............. 1 2 6 6 
Re 212 247 161 192 




















Average ranks for each item and the differences in rank from the 


items in regular and reversed order were computed. 


TABLE II.—AVERAGE RANK OF FIFTEEN ITEMS WHEN PRESENTED IN ORIGINAL 
AND REVERSE ORDER, AND DIFFERENCE BETWEEN THESE AVERAGE RANKS 











Average rank 
oom Items presented Items presented umasence 
in regular order in reverse order 

1 6.205 7.548 1.343 
2 9.686 10.551 .865 
3 8 . 236 9.086 .850 
4 6.221 8.047 1.826 
5 9.126 9.317 .191 
6 7.654 7.890 . 236 
7 6.958 7.539 .581 
8 6.875 7.311 .436 
9 8.190 8.327 .137 
10 ‘7.221 6.440 — .78l 
11 ‘6.964 6.510 — .454 
12 10.232 9.942 — .290 
13 9.334 8.192 —1.142 
14 8.682 6.738 —1.944 
15 8.364 6.581 —1.783 
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The linear and quadratic curves of best fit were computed for those 
points by the method of least squares with the following results: 


y = —0.2207 + 1.764 
y = —0.0106z7? — 0.0487 + 1.266 


Inspection of the results leads one to the conclusion that the 
relation between tendency to overrank and order of ranking is linear. 
The coefficient of the z? term in the quadratic is very small and the 
curvation of the quadratic is slight. The linear equation shows 
y = .000 when z = 8 indicating that there is no deviation for the mid- 
dle rank. It would seem that the strength of the tendency to overrank 
items coming early on the list and to underrank items coming late on 
the list is directly proportional to the distance of the item from the 
middle item. 

By a translation of axes the above equation may be written 
y = —0.220z where zx = 0 is the middle item in any series. From this 
simple equation the distortion in rank for any number of items may be 
computed. For instance, if there are two items to be ranked, for the 
first item zr = —l4 andy = .11. That is, if the average rank of the 
first item is r then the average rank when the order of the two items is 
reversed is r — .11 and the most probable value of the average rank of 
the first item is r — 14 of .1l orr — .055.' Similar computations may 
be made for the ranking of any number of items. 

There is at least one factor which destroys the generality of the 
above relationship. The distortion in ranking due to order of pre- 
sentation of the items is a function of the method of presentation. 
Mathews, for instance, in the paper referred to above found the influ- 
ence of order much greater when items were presented vertically than 
when presented horizontally. Order of presentation should have 
practically no effect when the ranking is to be accomplished by sorting 
cards. 

Maturity on the other hand which might be thought to influence the 
distortion in ranking which is due to the order of presentation of the 
items apparently has little influence. The rankings of two hundred 
sixty-six students at the Emporia, Kansas State Teachers College 
when the material was presented in the original order was compared 





1] have computed from Mathews’ data that the difference in average rank for 
his two item situation was .032 in the case where material was horizontally pre- 


sented and .338 where vertically presented against a difference of .110 computed 
from my data. 
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with the rankings of two hundred fifty students at the same institution 
the next year when the material was presented in the reverse order. 
The results were almost identical with those obtained from the high 
school group, the relation again being a linear equation y = —.209z + 
1.693. Evidently the influence of order of presentation of items is not 
markedly affected by age or maturity. 

The influence of order of presentation on the standard deviation of 
the rankings for each item was investigated. No consistent trend was 
evident. These data lead to the conclusion that the variability of 
ranking is not a function of the order of presentation of the material. 
This may be interpreted as saying that there was no tendency for 
greater discrimination to be shown in ranking the earlier items of a list. 

The following tables may be used in correcting for order of presenta- 
tion in ranking. These tables may be used in correcting rankings 
obtained from high-school pupils and may be taken as a first approxi- 


TABLE III.—CorRREcTION VALUES TO BE APPLIED TO AVERAGE RANKING WHEN 
THERE ARE AN Opp AND AN EvEN NuMBER oF ITEMs TO BE RANKED 








When an odd number of items When an even number of items 
are to be ranked are to be ranked 

7th item preceding. 7th item preceding. 

ee +.770 es en i ee bane 6 +.715 
Rss. Ot ace wie dblec aaa i oe + .605 
SU eit ce Ak ka akad ake PF Uc cccsccccvccsesecassvecce. Se 
tien can ca Ae 6 Oka eee at et ke ie lit + .385 
SAS Ee re ee eer te a eee + .275 
ra, Be dwb ide CEM aA eN Ok tence wane eueen We ke + .165 
EE Ee ee cake conch sine deride ees + .055 
ia, iow se wy ios wl .000 
Ist item following. 1st item following. 

I 5 5:6 0-6 oso 50e 0% —.110 OID oc vik ewwaceces — .055 
ee ee se wae SS on Hecate sl cub eee be oe ees — .165 
nee nah aa a oe ee A I 5 a cub ke ks eendncsiancese — .275 
ie aa aa hae be eee Es os cidetewess cavdassreece ae 
anes Ain sacle ain diehl dies rhc sha todd ia ct eto to ed Oras we — .495 
I iti ails ce ns eicdtan nec ho eee eto oa re ie oo ale — .605 
as Nhs ame aed bale irs tal td cthéndaks whee bakeeses —.715 








mation until further studies make refinements to care for method of 
presentation. These tables are one-half the linear regression values 
and indicate the amount to be added or subtracted to give the most 
probable average rank. 





D 
Ai 








5 
5 


) 

5 
15 
5 


5 
05 
15 
35 
95 
05 
15 


of 
es 
st 


Influence of Order of Presentation 449 


For instance, if there are five items to be ranked, +.220 should be 
added to the rank of the first item. If four items are to be ranked, 
+.165 should be added to the rank of the first item. 


°2 « 
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Difference between average ranks when material is presented in original and reversed 

order. 
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RELATION OF HANDEDNESS, EYE-SIGHTING AND 
ACUITY DOMINANCE TO READING! 


ARTHUR I. GATES AND GUY L. BOND 


The article reports the results of the relations of handedness, 
eye dominance for sighting, visual acuity and combinations of these 
to reading in the case of three, and in some cases four, groups of 
children, as follows: (1) A group of sixty-five retarded readers with 
a mean age of 8.61 years and (2) a control group of sixty-five normal 
readers equivalent in age, intelligence, number of years in school and 
socio-economic background,? (3) a group of fifty-five first-grade 
pupils measured repeatedly during the year, and (4) a group of fifty- 
seven first-grade pupils studied during the first half of the year. The 
first two groups reveal the relationships after several years of school 
experience, the second pair during the initial stages of learning. 

Handedness was determined by five tests as follows: Using a 
hammer, spinning a top, cutting with scissors, picking up small 
articles, afd throwing a ball. Eye dominance was determined by 
using the Parson’s Manoptoscope and by one or more tests of sighting 
with a pencil or finger. Visual acuity was measured by the Snellen 
““E”’ chart, for distant vision, and the Jaeger chart for near. The 
acuity test slides of the Betts Telebinocular were also used.* 

Table I shows the average attainments on different tests secured 
by pupils showing different degrees of handedness, or more exactly by 
those testing “‘right”’ in all five, or in one to four tests out of five, 
or left-handedness in all five. It will be seen that this table shows 
no consistent trend. Among the normal readers, the pupils clearly 
right-handed have somewhat better scores, whereas among the poor 
readers the reverse is true. The mixed-hand dominance groups are 
between in both groups. The number of the left and mixed-handed 
cases, is, of course, too small to give reliable data. In this table and 
in others following, measures of statistical reliability have not been 





1 The studies reported in this article were made possible by support received 
from the Works Progress Administration through the agency of the Board of 
Education of New York City. 

* Further details concerning these two groups will be found in Bond, G. L.: 
The Auditory and Speech Characteristics of Poor Readers. Teachers College Contri- 
butions of Education, No. 657, 1935. 

’ For details concerning the tests of visual functions see Fendrick, P.: Visual 
Characteristics of Poor Readers. Teachers College Contributions to Education, 
No. 656, 1935. 
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computed, since the consistency from group to group is even more 
significant and can be discerned by casual inspection. 


TaBLE I.—MegaAn Scores OF Pupits OF DIFFERENT DEGREES OF HAND 
































DOMINANCE 
Number Word | Mispro- | Per cent Per cent 
Reading ' wrong 
Handedness of pronun- | nuncia- | rever- 
, grade ee ; begin- 
pupils ciation tion sals 
nings 
Normal Readers 
| 58 3.9 64 9.2 7.0 15 
One to four right...... 4 3.4 60 11.1 6.5 17 
DM bcccctddnasews 2 3.5 58 10.9 8.1 14 
Poor Readers 
Piwe iM... oc ccccces 57 2.0 23 56 9.2 17.6 
One to four right...... 5 2.1 21 59 10.3 13.1 
a énwucy be bones 2 2.2 44 25 8.5 8.5 























Among the first-grade pupils, fifty out of fifty-five were graded as 
right-handed and five as left, in tests given about two months after 
In two tests of reading given 
at mid-year and in three at the end of the year, the two groups were 
almost identical, and in tests of word pronunciation the percentage of 
reversals errors were ambiguous, as shown in Table II. 


the opening of school to one group. 


TaBLE II.—Scores tn READING ABILITY AND PERCENTAGES OF REVERSALS BY 


FIrRstT-GRADE Pupits OF DIFFERENT HAND DOMINANCE 








Reading} Para- Word Sen- Para- 
Reversal) Reversal 
vocabu-| graph | recog- | tence graph 
: ne ' 4 errors | errors 
Handedness} lary | reading] nition | reading | reading 
. ” test 1, | test 2, 
mid- mid- end end end 
per cent | per cent 
year year year year year 
Right....... 13 22 2.3 2.4 2.4 27 17 
SE 11 19 2.2 2.4 2.5 37 8 


























The scores in various tests of pupils showing right, left or uncertain 
eye dominance for the older children are shown in Table III and for 


a 


i 
; 
; 
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one of the first-grade groups in Table IV. There is no consistent 
relationship among these factors in these three groups. 


TasBLeE II].—MeEan Scores For Pupits or Rigut, Lert or Mrxep Eye 












































DoMINANCE 
Word Total Per cent Per cent 
Eye Number | Reading mispro- wrong 
, , pronun- rever- IQ 
dominance | of pupils} grade rg nuncia- begin- 
ciation sals ; 
tions nings 
Normal Readers 
Right........ 32 3.9 63 11 5.9 10.6 101.2 
renee 28 3.8 63 10 7.2 13.5 101.8 
Mixed....... 4 4.2 66 0 0 16.0 110.7 
Poor Readers 
Riget........ 32 2.1 25 50 7.5 17 99.1 
AG oeckie nn 30 2.1 23 55 10.0 16 101.1 
Mixed....... 2 1.5 12 141 15.0 12 97.5 




















TaBLE IV.—MEAN Scores FOR FirstT-GRADE Pupits oF Ricut, LEFT or MIXED 
Eye DOoMINANCE 








Reading | _ Para- = one 
Eye Number | vocabu- | graph alin Reversal | Reversal 
dominance of pupils | lary mid-| reading ‘ote g test 1 test 2 
year mid-year Bad year 
a eines 29 12.8 22 2.37 35 17 
ee aes: 18 11.2 21 2.35 25 15 
Ee 8 12.9 21 2.33 26 21 























Table V shows the scores in various tests of the older pupils when 
grouped according to the eye showing superior visual acuity in near 
vision by the chart. 
inspection to be unimportant and unreliable. 

Table VI shows the number of errors made in a special pronuncia- 
tion test including many reversible words by the older pupils having 


the same and different lateral dominance of hand and eye. 


Differences in both groups may be seen by 


Among 


the normal readers, the cases of mixed dominance show larger per- 
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TaBLE V.—MEAaN Scores or Pupiis oF Superior Ricuat or Lert or IDENTICAL 



































Eye Acuity 
Per cent 
, .; Number | Reading ween Per cent | wrong 
Superior eye ‘ pronun- IQ 
of pupils | grade Sih reversals | begin- 
ciation : 
nings 
Poor Readers 
eee S 2.01 23 15 8 | 99.6 
eb apie 10 2.06 29 11 28 10.2.2 
I ad acd ie Sd 46 2.06 23 9 16 100.4 
Normal Readers 
7 3.65 | 59 Oe 8) | 100.4 
RE 9 3.75 | 60 7.3 ig | 100.4 
Same.......... 48 3.85 | 64 5.0 13 | 102.5 





centages of reversals than the right-eyed-right-handed pupils but 
the trend among the poor readers is the reverse. 


TaBLE VI.—Scores ON PRONUNCIATION TESTS OF PuPILS SHOWING DIFFERENT 
COMBINATIONS OF EYE AND HAND DOMINANCE 


























od t Number Total Per cent 
Combination ' 
of pupils errors reversals 
Normal Readers 
Right eye—right hand..................... 27 11.2 3.2 
Left eye—right hand...................... 23 7.5 5.0 
Other mixed combinations.................. 14 8.6 6.5 
Poor Readers 

Right eye—right hand..................... 27 46.7 7.0 
Left eye—right hand...................... 28 51.4 6.5 
Other mixed combinations.................. 9 49.3 6.0 





Table VII shows the scores made on two different tests of reversal 
tendencies of which the first is Test VIII—2 and the second Test 
VIII—3, of the Gates Reading Diagnostic Tests (1935 edition). 
Each of these tests was given at the beginning, middle, and end of the 
year to group I (the group previously mentioned) and at the beginning 
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and middle of the year to forty-six pupils from the other first-grade 
group. The results for these groups combined comprise Table VII. 


TaBLE VII.—PERCENTAGE OF REVERSAL Errors MADE BY FIRST-GRADE Pvupits 
GrovuPrEep AccORDING TO HAND AND Eye CoMBINATIONS 




















Recognition of Recognition of 
re Number words seen words heard 
Combination ; 
of pupils 
Test 1 | Test 2 | Test 1 | Test 2 
Right hand—right eye.......... 39 5.1 6.0 4.5 4.5 
Right hand—left eye........... 24 4.8 4.8 4.5 3.6 
Left hand—left eye............. 2 3.9 5.7 3.9 5.3 
Left hand—right eye........... 3 6.2 4.8 5.7 5.7 











TaBLE VIII.—MeEan Scores 1N SEVERAL TEsTs OF PUPILS OF VARIOUS 
CoMBINATIONS OF EYE DOMINANCE (AIMING TESTS) AND EYE Acuity 









































| 
cata Number Silent Percep- | Percep- | Per cent 
Combination .,.| reading |.. 
of pupils tion, G1 | tion, G3 | reversals 
grade 
Normal Readers 
Right aim—right acuity........ 4 3.8 11.5 13.0 2.3 
Right aim—same acuity......... 23 4.0 19.7 11.4 3.8 
Left aim—left acuity........... 6 4.0 21.2 12.2 22.4 
Left aim—same acuity.......... 18 3.8 18.6 13.1 2.8 
All others, mixed............... 13 3.9 19.3 12.7 3.0 
Poor Readers 
Right aim—right acuity........ 5 2.1 14.6 9.0 8.8 
Right aim—same acuity......... 21 2.6 14.6 9.2 7.4 
Left aim—left acuity........... 5 1.9 13.6 10.4 16.2 
Left aim—same acuity.......... 21 2.1 17.0 9.5 10.8 
All others, mixed............... 12 2.0 14.5 9.7 10.4 




















Above Data for Two Groups Combined and Certain Categories Consolidated 





Right aim—right or same acuity 52 
Left aim—left or same acuity... . 50 
EE ia 86 bewinelewnbcas on ea bate 25 


3.3 
2.9 
3.0 


| 
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It will be noted that no group shows the reversal tendency reliably 


greater than the right-handed-right-eyed group. 
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The older pupils may be divided into several groups according to 
the relationship of eye-dominance, on the bases of aiming tests, and 
eye-superiority in acuity. Table VIII gives some of the data when 
acuity is measured by the near-vision chart. The “mixed groups” 
include all possible combinations except those listed separately in the 
table. Tests Gl refers to the Gates Perception of Geometrical 
figures; Test G3, to Gates Perception of Digits; and Percentages of 
Reversals to the pronunciation of reversal words test in the Gates 
diagnostic series. 

For the first-grade children similarly grouped are given the scores 
in a test of perception of digits, and three tests of reversal tendencies in 
addition to the reading grade based on the mean grade scores obtained 
from the three Gates Primary Reading Tests given at the end of the 
year. 

The scores for the several groups of the older children are similar 
except for the relatively high percentage of reversals made by those 
having left-eye aiming dominance and left-eye superiority in acuity. 
This tendency does not appear, however, in the results for the first- 
grade pupils. 


TaBLE [X.—ScoreE 1n SILENT READING, PERCEPTION, AND VARIOUS TESTS OF 
REVERSAL TENDENCIES FOR FiRsT-GRADE Pupits GROUPED ACCORDING TO 
Eye (Armina) DoMINANCE AND ACUITY 
































_— Per Per Per Per Per Per 

wen Read-| Per- | cent | cent | cent | cent | cent | cent 

Combination ~~ ing cep- | rever-|wrong,| rever-|wrong,| rever- | rever- 
pupils grade tion | sal, | order! sal, | order| sal, sal, 

test 1 | test 1 | test 2| test 2 | test 3) test 4 
Right aim—right acuity....... 6 2.2 26 3 4 5 11 6 23 
Right aim—same acuity....... 17 2.5 37 8 12 9 16 16 25 
Left aim—left acuity......... 3 2.6 41 3 3 5 5 29 17 
Left aim—same acuity........| 11 2.3 32 12 15 9 15 12 | 19 
All others, mixed............ 15 2.4] 33 9 12 6 12 | 28 | 41 





Above Data Consolidated 





Right aim—right and same 


Dcvtcvcccctdveaeneveee 23 2.4 — . « 10 8 15 14 24 
Left aim—right and left acuity| 14 2.4 34 10 13 8 12 16 19 
Gtk deka tach conswe kate 15 2.4 33 9 12 6 12 28 41 
































In summary it may be said that the data obtained from groups of 
first grade pupils, older normal readers, and older reading problem 
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cases, show no consistent tendency for eye dominance, single eye 
superiority in acuity, hand dominance, or any combination of these 
to be related to achievement in reading, word pronunciation, reversal 
errors, or visual perception of various items. A survey of the tables 
will show a remarkable similarity in the number of pupils in the various 
categories in the normal and defective reading groups. This in itself 
is evidence that eye and hand dominance have little to do with read- 
ing difficulties. The data, in general, are in harmony with those 
published by Woody and Phillips, Gates, Kirk, Teegarden, Witty 
and Kopel! and others. 





1 A very complete bibliography of studies on this topic will be found in Witty, 
P. A. and Kopel, D.: ‘‘Sinistral and Mixed Manual-Ocular Behavior in Reading 
Disability.” Journal of Educational Psychology, February, 1936, pp. 132-134. 
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A FORMULA FOR INTERCORRELATIONS AMONG 
MULTI-SCORES 


ELMER B. ROYER 


Oklahoma Agricultural and Mechanical College 


I. INTRODUCTION 


Of late, it has become good practice to score personality and interest 
blanks a number of times, with a different key each time, and thus to 
obtain a number of scores from the same pattern of responses. After 
the blanks have been scored in this manner, the intercorrelations are 
computed and reported in the literature, presumably as evidence of the 
relationship existing between the traits which the scores are supposed 
to represent. 

As Lorge! has pointed out, the correlations may be due partially 
to the relationships existing among the keys. In order to show this for 
the Bernreuter Personality Inventory, Lorge computed the correlations 
among the keys. Since each key gives separate weights for the “‘ yes,” 
“no,” and ‘‘?”’ responses, he computed three sets of intercorrelations. 
He found the intercorrelations of the ‘‘yes”’ weights and those of the 
“no”? weights to be similar to the intercorrelations of the total trait 
scores. The correlations of the ‘‘?”’ weights are much smaller in 
magnitude, though still in the same direction. 

Since there is only one set of intercorrelations of the total trait 
scores, logically, any method which purports to show how much of this 
correlation is due to the relationships existing among the keys should 
yield only one set of intercorrelations. Moreover, the method used 
should have a logical basis. The fact that the intercorrelations of the 
‘‘ves”’ weights, and those of the ‘‘no”’ weights approximated the inter- 
correlations of total trait scores may be an a posteriori reason for sup- 
posing that this method is legitimate, though Lorge advances no 
argument for its use. 

The purpose of the present article is to develop a formula for 
estimating the amount of correlation due to the relationships existing 
among the keys, and to compare this formula with other methods, both 
as to logical bases and as to results. 





1 Lorge, Irving: ‘‘ Personality traits by fiat. I. The analysis of the total trait 
scores and keys of the Bernreuter Personality Inventory.” J. Educational 
Psychol., Vol. XXVI, April, 1935, pp. 273-278. 
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Il. DERIVATION OF THE FORMULA 


Let X1, Xo, . ..,X,» be the scores obtained by applying the n 
keys in turn to the testees’ patterns of responses. Let 
Mi, TPs, .-.- 52m 


be the scores on the m items, each to be 1 or 0, accordingly as the 
response is ‘“‘yes”’ or ‘‘no” (or like or dislike). Also let 


be the differential weights assigned the items by Key 1, and likewise for 
the other keys, letting the first of the two subscripts designate the key 
and the second, the item number. 

Then the score obtained by applying Key 1 to the responses will be 


Xi = aul) + awe + ++ + + aQiml'm (1) 
Passing to the deviation scores, 
Dy = Myy¥1 + i272 + °° + + aimYm (2) 
LLiLo = 3102) D717 + ai2ae2Dy27 + + + + Aim@2mZ Ym? + 
cross-products (3) 
r2;? = a1? Dy? + 12? Dy2” + ++ + aim? Zena? + 


cross-products (3) 


From (3) we may now write the formula for the correlation between 
scores obtained by applying Keys 1 and 2 


3110012717 + aiae2Dy2? + °° * + 
V an? 21? + as" Zy3? +° °° + 1m? ZY m? 
+ cross-products 
Aima2mLYm? + cross-products 
V 21? Dy1? + aan? Zy2?+ - + + + em? DY m? 
+ cross-products 





Yxix. = 








(4) 





This is the complete formula, and must give the exact correlation. 
However, in this form it is cumbersome to use, and a simplified formula 
may give good results. 

If we assume that the items are uncorrelated, 


Zv172 


——————— = () 
V DyV/ Zy?2? 





yy: 


whence 


Z7i¥2= 0 (5) 
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and all the cross-products will disappear, leaving the fomula much 
simplified. Even though the intercorrelations of items are not zero, 
they are small. Since some of the ‘‘yes”’ responses, for which T = 1, 
are favorable, and some are unfavorable, to the trait for which the key 
is made, some of the intercorrelations of items will be positive and some 
will be negative. This fact causes the sum of the cross-products to 


approach zero still more closely, and proves the reasonableness of the 
above assumption. 


Applying the gross-score formula! to the item, 
N%o? = NXP — (SIP)? 
but, since T is either 1 or 0, 
>t = LI? = number of persons passing the item, 
hence, 
N%o? = N&Yr — (21)? 
and 


2 


ce=p—p =p (6) 


where p is the proportion of persons passing the item and q is the pro- 
portion failing it. 


Lyi? = No? = No.0: (7) 


If we drop the cross-products from (4), make substitutions from 
(7), and cancel the N’s, we may write the formula for correlation 


0611021191 + Gi2a22Pege2 +° °° + 





YxiX: — 











V a? piqi + O12"P2q2 tT°°° + Cin Dele 

Qi mA2mP m7 m (8) 

V a21?piqi + a22*poge + °° * + G2m*DmIm 
Again we write 

ap-F7 
Transposing, and adding 14 to both sides of the equation, 
+p? —p+4=M% 
whence 
o* + (p — 14)? = (14) (9) 





1Toops, Herbert A.: ‘‘Computing intercorrelations of tests on the adding 
machine.” J. Applied Psychol., Vol. VI, 1922, pp. 172-184. 
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This equation shows that, as p passes from 0 through 0.5 to 1.0, ¢ 
describes a semicircle with a radius 0.5 and with its center at (0, 0.5). 
From this we know that o does not drop away rapidly from 0.5 until p 
approaches the limits, 0 and 1. Consequently the value of o does not 
vary greatly within the middle range. 

Hence, we can still further simplify our problem by assuming 


71 =02= *** =Om (10) 


In which case, from (6) 


Pidi = Pode = ** * = PmIm 


When we use this assumption, all of the pq factors will become unity 
when the numerator and the denominator are divided through by 
pig; and the correlation between two scores may be written 


° 110121 + Qi2Q22 ++ - + + Aima&om 
V ai? + 12” +--+ + im? asi? + aes? +° °° + Oen* 
(11) 


This formula is an algebraic statement of the rule given by Hull! 
and attributed to him by Poisson. MHull’s problem was similar to our 
own. The rule is that for computing the theoretical correlation 
between two tests with common aptitude determiners. His deter- 
miners were uncorrelated, and we have assumed our items to be 
uncorrelated. We have had to assume in addition that the o of the 
item scores were equal. Although Hull seemingly made no such 
assumption, this condition no doubt was closely approximated when 
he threw five thousand dice for each of his determiners, for theo of any 
series of five thousand dice throws could not be far from the expected 
value of 1.708. 

If this formula is correct, how was Lorge able to secure good 
results by correlating ‘‘ yes” weights and ‘‘no” weights? It seemingly 
was due to a combination of circumstances. Upon examination it will 
be seen that the “‘yes”’ weight and the ‘‘no”’ weight for a given item 
on the Bernreuter keys are approximately equal in magnitude and are 
opposite in sign. If we let W represent the ‘“‘yes” weight and W’ the 
“no” weight, 





Yxix; = 








W = —W’ approximately 





1 Hull, C. L.: Aptitude Testing. World Book Company, 1928, pp. 230ff. 
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Since in our derivation we arbitrarily gave the “no” response a 
weight of zero, 


a= W — W’ (12) 
a = 2W approximately = —2W’ approximately (13) 


By substituting from (13) in (11), the correlation of scores may be 
written 


VE rw approximately (14) 
and likewise for the ‘‘no”’ weights. 
The formula for the correlation of weights may be written 
=WiW2 — NM\M:2 
DW ;? aos NM,2~/ =W:?? —_ NM? 
Since the means M,, Mg, etc., are not far from zero,! (15) is an 
approximation of (14), and therefore of the correct Formula (11). 
This explains how the incorrect formula gave the results that it did. 
The divergence between the results of (15) and (11) is introduced 
largely by the NM;M; term in the numerator and in the denominator 
radicands of (15), for (14) is a very close approximation of (11), as 
may be seen from Table I. 
In this table, the results obtained by Formula (14) show an average 


discrepancy of only .0115, whereas those obtained by Formula (15) 
show an average discrepancy of .0361. 





Tate 











YW, a 


(15) 


TABLE I.—CoMPARISONS OF RESULTS OBTAINED BY FORMULAS 








— “Yes” sé No” “Yes” “No” 
(11) weights weights weights weights 
formula (14) | formula (14) | formula (15) | formula (15) 

Tie — .301 — .300 — .298 — .265 — .261 
Ti3 . 856 . 850 . 830 . 804 . 800 
Ti4 = eae — .702 — .730 — .744 —.714 
Tez —.157 —.150 —.151 — .082 — .092 
T24 .450 .442 447 .434 .428 
Te — .526 — .491 — .527 — .531 — .489 




















III. CONSTRUCTION 


AND CORRELATION 


OF CHANCE SCORES 


In order further to investigate the Bernreuter Personality Inven- 


tory, one hundred patterns of responses were made by throwing dice. 





1 Lorge, Irving: Op. cit. Table II, p. 274. 
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A number of dice were thrown at a time and were lined up against the 
side of the box before the cover was removed in order to give a definite 
sequence for reading them. The first die determined the response for 
the first item, the second die for the second item, etc. If the die 
showed one, three, or five pips, the item was considered as marked 
“‘ves,”’ but if the die showed two, four, or six pips, the item was con- 
sidered as answered ‘‘no.”’ The ‘‘yes”’ weights were punched into one 
end of a Hollerith card and the ‘‘no”’ weights into the otherend. The 
card for an item answered ‘‘no”’ was turned end for end, thus bringing 
the no weights in line to add in the same counters on the tabulator as 
‘“‘ves’’ weights. Since there were just one hundred twenty-five cards 
in all, this arrangement greatly lessened the danger of counting both 
weights for one item, and compensating by failing to count either of the 
weights for another item. Following Bernreuter’s example,' we dis- 
regarded the ‘‘?”’ answers and made all answers either ‘‘ yes” or ‘“‘no.” 

In doing this, the odd-numbered items were at all times kept 
separate from the even-numbered items. The odd-numbered item 
cards were put through the tabulator first and the total printed. As 
the machine struck the total, some of the counters cleared out, but 
others adding from the same fields on the card did not. When the 
even-numbered item cards had been put through, the summary punch 
punched the total scores and the evens scores. The odds scores were 
then punched by hand from the printed tape, since the machine had 
cleared these numbers from the windows by this time. In order 
further to speed up the process of making the chance scores, two identi- 
cal decks of cards were used. ‘Two assistants throwing the dice and 
arranging the cards for the next pattern of responses were nearly able 
to keep up with the tabulator. Since the evens scores and the total 
scores were punched with the summary punch, a check which made the 
odds-score total and the evens-score total agree with the total-score 
total was sufficient to insure accuracy of punching. 

Thus there were obtained from each pattern of responses twelve 
scores—the total score, the odds score, and the evens score for each of 
the four keys. The intercorrelations of these scores were computed 
twice (as a check upon the accuracy of the computations) by means of 
the systematic method described by Toops.? The intercorrelations of 
the total score were computed separately from those of the parts 
scores. They are presented in Tables II and III. 





1 Bernreuter, R. G.: ‘‘Chance and personality inventory scores.” J. Educa- 
tional Psychol., Vol. XXVI, April, 1935, pp. 279-283. 
2 Toops, Herbert A.: Loc. cit. 
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TaBLE II].—INTERCORRELATIONS OF TOTAL CHANCE SCORES ON THE BERNREUTER 


PERSONALITY INVENTORY 








B1-N B2-S B3-I B4-D 
EE gsc a-We athe 6 eae a 1.000 —.190 . 869 — .733 
SEPT Pee Te eT — .190 1.000 — .087 . 337 
eee rer ery Serer . 869 — .087 1.000 — .574 
B4-D. — .733 . 337 — .574 1.000 
ONT OE Te eT CTE EET TTT TCS 16.67 0.93 16.58 18.40 
0 Ee Oe ne ea ee eee 29.25 24.99 20.57 23.48 

















TaBLE III.—INTERCORRELATIONS OF PARTS CHANCE SCORES ON THE BERNREUTER 
PERSONALITY INVENTORY 





Odds Evens 





Bi-N | B2-S | B3-I | B4-D | B1-N | B2-S | B3-I | B4-D 














' 
Bi-N.......| 1.000}—.258) .838) —.704| —.042) —.061)—.065) .022 
Odds ere — .258) 1.000) —.164| .428) .149}—.030) . 158) —.087 
ey . 838) — . 164) 1.000) — . 436) — .039) — .080) — .064| — .047 
B4-D....... —.704| .428)—.436) 1.000) .082)—.090) .075|—.146 
BI-N.......);—.042) .149)—.039) .082) 1.000)—.245) .907)—.724 
Evens | B2-S........ — .061| — .030| — .080) — .090) — . 245) 1.000)—.106) .372 
rer — .065) .158|—.064) .075) .907)—.106) 1.000) —.602 
B4-D....... . 022) — .087| — .047| — . 146) —.724| .372|—.602) 1.000 
Diktceenesesweceesre 5.30) 2.25) 6.44) 12.25) 11.37|—1.32) 10.14) 6.15 
Ee ee ee 19.03) 19.56) 14.68) 16.76) 23.02) 16.15) 15.38) 19.08 





























It will be noticed that wherever odds scores are correlated with 
evens scores, the correlations are easily explained as chance deviations 
from zero, with the possible exception of two. The intercorrelations 
of the evens scores agree well with those of the odds scores, and both of 
them agree well with the intercorrelations of the total scores. The 
means of the total scores are somewhat lower than those reported by 
Bernreuter,'! but the standard deviations agree fairly well with his. 


IV. COMPARISON OF RESULTS 


Table IV brings together these various results. In the first column 
are given the weighted means of the intercorrelations computed from 





1 Bernreuter, R. G.: Op. cit. Table I, p. 280. 
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actual scores by Lorge, Bernreuter, and Flanagan and presented by the 
Lorge.! The correlations were transformed into z’s, and these weighted Th 
proportionally to N-3 in finding the mean z. The mean 2’s were then 
turned back into 7’s.2, The computation of these means was greatly ris 
facilitated by the use of tables of z’s prepared by Edgerton.’ oa 
TasBLeE IV.—INTERCORRELATIONS OF ScORES ON BERNREUTER PERSONALITY cal 
INVENTORY the 
Mean of | Theo- Corre- Mean of ane 
four retical | lations of be sageier" Corre- Corre- Corre- sco) 
corre- corre- | one hun- possi lation of | lation of | lation of app 
lations of | lations by| dred satin, ‘“‘ves’”’ a “_ 
actual formula | chance ie weights! | weights! | weights! 
lations 
scores (11) scores 
(1) (2) (3) (4) (5) (6) | () ’ 
Ti2 — .431 — .301 — .190 — .251 — .265 — .254 — .220 
T13 - .960 . 856 . 869 .877 . 804 . 804 . 257 
14 — .812 — .737 — .733 —.714 — .744 — .696 — .176 
23 — .339 —.157 — .087 — .135 — .082 — .092 — .057 
24 . 565 . 450 .337 .401 .434 .428 .215 
34 — .705 — .526 — .574 — .524 — .534 — .489 — .100 ] 
1 From Lorge: Loc. cit. that 
enot 


In the second column are presented the theoretical correlations 
computed by Formula (11). In the third column are presented the J 


correlations of the total chance scores from Table II. In the fourth muc 
column are given the means of the odds and evens correlations from num 
Table III. In the fifth, sixth, and seventh columns are given the the | 
correlations of the ‘‘yes,” ‘‘no,” and ‘‘?” weights, as presented by ships 


Lorge.* T 


At a first glance, it would seem that some of the chance correlations tions 
in Column 3 deviate too far from the theoretical correlations in Column may 
2. An investigation by the z method shows that random samples of a 

OI Sci 


one hundred could vary as widely as the correlations in Column 3 do. 
Using Fisher’s® technique, the critical ratios for the six correlations T 





(that is, the difference between the z’s divided by the standard error of the i 
We as 
1 Lorge, Irving: Op. cit. Table I, p. 274. se 
2 Fisher, R. A.: Statistical Method for Research Workers. Edinburgh: Oliver 
and Boyd, 1930, Third Edition, pp. 170ff. 
3’ Edgerton, H. A.: Transformed Correlations. Mimeographed, 9 pp. A 
4 Lorge, Irving: Loc. cit. betwe 


5 Fisher, R. A.: Op. cit., p. 169. 
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the chance z) are found to be within the limits explainable by chance. 
They are presented in Table V. 

For the two correlations where the critical ratio is large (namely, 
rig and 7re4) it was noticed that both the odds correlations and evens 
correlations from Table III gave a closer approximation of the theoreti- 
cal correlation than the total-score correlation did. For that reason 
the two correlations were averaged for Column 4. It would have been 
much more desirable to make up two or three hundred more chance 
scores to see whether the correlations from the larger numbers would 
approach the theoretical correlations more closely. 

TaBLE V.—DEVIATION OF CHANCE CORRELATIONS FROM THEORETICAL 


CORRELATIONS IN TERMS OF THE STANDARD ERROR 
(Using the z-technique) 


CORRELATION Criticat Ratio 
Re 6 od + 28h ae EO ER Oe ae ae OE eo 6 ee 09) 4 8 TSO ¢ 16 
Pe ae eS ROAD HEESS EAE HOR ETEA TK KOO OCHRE R OR ORO HOODEO -., 50 
ae a er ee a ae a oe en ae eee ee eee eee ae ae .09 
eee See ee ee ee a ee ae a ee a eae PECTIC TC ee .70 
PPT EET LCCC CCC CU CLE LORTTTE CULT TCR 1.32 
ee ee ee ee ee ee ee ee ee a ee ee ee ee a ee eee eee — .68 


By comparing Columns 5, 6 and 7 with Column 2, it can be seen 
that the method of correlating item weights does not give results good 
enough to warrant the use of this method in place of Formula (11). 

A comparison of Columns 1 and 2 shows in a striking way that 
much of the correlation found between scores obtained by applying a 
number of the keys in turn to a given pattern of testee responses, on 
the Bernreuter Personality Inventory at least, is due to the relation- 
ships existing among the scores. 

This correlation may exist in the general population, and the correla- 
tions among the criterion scores found on the standardizing population 
may be adduced in support of this view. But since such large correla- 
tions are built into the keys, let us be chary about accepting correlations 
of scores obtained by using these keys as evidence for it. 

The differences between Columns 1 and 2 are due to the facts that 
the items are not uncorrelated, and that their o’s are not all equal, as 
we assumed in developing Formula (11). 


Vv. SUMMARY 


A formula was derived for estimating the correlation to be expected 


between scores obtained by scoring a given set of papers more than 
once. 
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It was-explained how an incorrect formula had happened to give 


good results. 

Attention was called again to the fact that correlations of successive 
scores obtained from a given set of test papers should not be offered 
as evidence of the existence of that correlation in the population at 


large. 
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OVER-COMPENSATION IN FINGER TIMING AS A 
FACTOR IN TYPEWRITING ERRORS 


NEIL WARREN 
University of Southern California 


When it is intended that the two hands shall move simultaneously 
there is a consistent tendency for the hand not used in writing to 
precede the “preferred” hand. Metfessel and Warren,! whose results 
agreed with those of other studies, believed that the prior movements 
were caused by the tendency to over-compensate with the less-used 
hand. It has been shown, in addition, that when two fingers are 
moved together the less-used finger will consistently precede.* For 
example, the little finger of either hand will move before the forefinger 
of the same, or of the opposite hand. This, again, seems best 

xplained on the basis of over-compensation; of making greater 
allowance for the inferior member than is required by objective 
differences. 

The interval by which one finger precedes the other in attempted 
simultaneous movement is ordinarily very short. In most bimanual 
activities its effect on the temporal relationship of the hands would 
be of little practical consequence. The accuracy of some such activi- 
ties, however, may be effected by the tendency to over-compensate 
with the less-used member. The relative movements of coérdinated 
digital processes are more likely to be affected by the tendency. 

Typewriting Errors.—The tendency toward prior movement by the 
less-used finger in the various combinations may be of significance 
in such finger activities as typewriting, linotyping, and piano playing. 
Of such performances typewriting best lends itself to study since a 
record of the movements involved is produced by the activity itself. 
In typewriting errors those which might be a result of the tendency 
are transpositions, in which the error is a result of incorrect order of 
finger movements. 


ANALYSIS OF TRANSPOSITIONS 


In the study of this problem an analysis has been made of three 
hundred fifty-three transpositions, comprising 16.5 per cent of the 
letter errors in typewriting tests of sixty high-school pupils in classes in 


typing III and IV. These tests were made over a period of three 
weeks. 
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Arbitrary Classification.—For purposes of classification the fingers 
of the right hand have been numbered R-1, R-2, R-3, and R-4, begin- 
ning with the index finger. The digits of the left hand are similarly 
numbered L-1, L-2, L-3, and L-4. The fingers have been ranked 
arbitrarily in the order of their use from the least to the most in the 
following way: L-4, R-4, L-3, R-3, L-2, R-2, L-1,and R-1. Thus, in the 
usual system of “‘touch” typewriting, the letters NA would be typed 
by the fingers R-1 and L-4 in that order. If the finger movements were 
attempted simultaneously the results of the study reported by Warren? 
indicate that L-4 would move first and reverse the letters in about 
seventy per cent of the trials. Ordinarily, of course, it is intended that 
N should precede A by an appreciable interval of time so that trans- 
positions need not occur so frequently. 

It is significant, therefore, that as the speed of typewriting increases 
and the succeeding strokes approach more nearly to simultaneity, 
the proportion of errors which are a result of transpositions increases 
rapidly. In typing I the average number of strokes per minute was 
61.6, and 2.1 per cent of the letter errors were reversals of finger order. 
The average number of strokes in typing III and IV was 207.5 and the 
percentage of transpositions was 16.5. That is, while the speed of 
typewriting increased 3.4 times, the proportion of transpositions to the 
total letter errors increased 7.8 times. At the same time the total 
number of errors decreased slightly in relation to the number of strokes 
made, being only .9 as great. 


RESULTS OF ANALYSIS 


The results of the tabulation of transpositions are given in Tables I 
and II. In Table I each finger is compared with those which receive 
less use. The fingers are arranged in each table in the order in which 
they exhibit the influence of the tendency toward over-compensation 
by preceding more-used fingers, and by following less-used ones. The 
fourth finger of the right hand is omitted because of insufficient data; 
it was involved only eight times. 

Precedence of Less-used Fingers.—It will be noted in Table I that 
the least-used fingers (L-3 and L-4) are most likely to precede, rather 
than to follow more-used ones. R-2 and R-3, at the lower end of this 
list, are found in Table II to show the greatest tendency to follow, 
rather than precede, less-used fingers. In general, the indications are 
that the less used a finger is, the more likely it is to appear first in 
transposition errors, while the more-used fingers tend to appear 
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second. The four least-used fingers (L-4, L-3, R-4, and R-3) precede 
more-used fingers one hundred thirty-one times while they follow the 
same fingers seventy-two times. The four most-used fingers (R-1, 
R-2, L-1, and L-2) follow less-used fingers in one hundred seventy errors 
and precede them in one hundred thirty-two. In 61.4 per cent of the 
transpositions involving both hands, the left hand incorrectly 


TaBLE I.—RELATIONSHIP OF Eacu FINGER TO MoRE-vUSED FINGERS IN 
TYPEWRITING TRANSPOSITIONS 











Precedes more-used fingers Follows more-used fingers 
Finger 
Number Per cent Number Per cent 
L-5 42 77.8 12 22.2 
L-4 58 67.4 28 32.6 
L-1 33 57.9 24 42.1 
L-2 34 50.0 34 50.0 
R-3 30 50.0 30 50.0 
R-2 12 48.0 13 52.0 

















TaBLe I].—RELATIONSHIP oF Eacu FINGER TO LESS-USED FINGERS IN 
TYPEWRITING TRANSPOSITIONS 











Follows less-used fingers Precedes less-used fingers 
Finger 

Number Per cent Number Per cent 
R-3 33 82.5 7 17.5 
R-2 28 65.1 15 34.9 
R-1 76 56.3 59 43.7 
L-1 54 54.5 45 45.5 
L-3 4 50.0 4 50.0 
L-2 12 48.0 13 52.0 

















responded before the right. There were twice as many errors caused 
by a finger of the left hand preceding the corresponding finger of the 
right hand as caused by the right hand moving first.* 





* It may be pointed out that in the ‘“‘touch system”’ of type-writing the fingers 
rest upon a certain set of keys (L-4 on A, L-3 on S, L-2 on D, L-1 on F, R-1 on J, 
R-2 on K, and R-3 on L) and that one of these keys may be struck by the finger 
resting upon it while another finger in reaching for a key in another row. This 
would account for only 20.1 per cent of the errors. Moreover, of the errors not 


involving the ‘‘guide”’ keys, the percentages remain virtually the same as given in 
Tables I and IT. 
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It is significant that 57.5 per cent of the transpositions involved 
the third and fourth fingers, while 29.7 per cent of the letter substitu- 
tion errors in general were caused by these fingers. Pillé*? reported that 
17.8 per cent of the letter substitution errors involved the third and 
fourth fingers. Only the most frequent transpositions of her study are 
listed; of these, however, 79.0 per cent of one hundred thirty-eight 
errors are caused by prior movement of a less-used finger. 


CONCLUSIONS 


1. There is a consistent tendency for the less-used finger to precede 
a more-used one, when it is intended that the two shall move 
simultaneously. 

2. The tendency is sufficiently definite to affect finely codrdinated 
digital activities. 

3. Analysis of typewriting errors indicates that the order of finger 
movements may be influenced so as to result in transpositions. 

4. While all transpositions cannot be a result of the tendency to 
overcompensate, the tendency is a factor to be considered in methods 


of instruction in typewriting. 
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BISERIAL r VERSUS PEARSON r AS MEASURES OF 
TEST-ITEM VALIDITY 


FRANCES SWINEFORD 
Research Assistant, University of Chicago 


One of the most troublesome questions which arises in the construc- 
tion of tests is the selection of a method for validating the test items. 
Much attention has been given to the various available methods, but 
workers in the field fail to agree as to which is better, the Pearson 
correlation or the Biserial correlation for dichotomously scored items. 
The proponents of the former hold that the distribution of scores on 
an item which is scored “‘right”’ or “‘ wrong” is discontinuous and cannot 
be considered normal in form. It is the purpose of this paper to 
present arguments in favor of the Biserial correlation in the case of 
items for a test which measures an ability or characteristic which is 
normally distributed throughout the population. The labor of the 
computation of the various measures of validity has been treated in an 
earlier discussion! and will not be taken into account here. 

The theory that certain physical and mental characteristics are 
normally distributed has been generally accepted. A well-balanced 
test of any of these characteristics may be expected to give results 
whose distribution closely approximates the normal curve. If, how- 
ever, the test contains a preponderance of easy or of difficult items, the 
distribution of scores will be negatively or positively skewed. By this 
reasoning it may be argued that the distribution of test scores, per se, 
does not define the distribution of the characteristic which the test 
measures. Without evidence to the contrary, a normal distribution 
may frequently be assumed, for ‘‘the normal curve is the best single 
approximation to most educational data.’’? 

A single test item might itself be conceived as a test of the charac- 
teristic in question. Under the assumption that the characteristic is 
normally distributed, the scores on the single-item test may also be 
assumed to be normally distributed. The fact that the responses can- 
not be assigned to more than two categories need not alter such assump- 
tion. In such case the use of the Biserial r is justified. 





1Swineford, Frances: ‘‘Validity of Test Items.’’ Journal of Educational 
Psychology, Vol. XX VII, January, 1936, pp. 68-78. 

2 Holzinger, Karl J.: Statistical Methods for Students in Education. Boston: 
Ginn and Company, 1928, p. 221. 
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The important advantage of the Biserial r over the Pearson r is the 
fact that the former is not affected by extreme values of the difficulty 
of the item. ‘The Pearson r is considerably lowered for items whose 
difficulty rating lies outside the range of twenty to eighty per cent. 
For purposes of illustration, both the Biserial r and the Pearson r were 
computed for one hundred ninety-one mental-test items ranging in 
difficulty from five to ninety-five per cent. Their respective coeffi- 
cients of correlation with balance (the smaller of p and q) are .0055 — 
and .2714. The correlation between the values determined by the 
two methods is .9371, which becomes .9655— when seventeen items 
whose balance is less than ten per cent are eliminated. The mean 
Biserial 7 for the one hundred ninety-one items is .451 and the mean 
Pearson 7, .327. For the one hundred seventy-four items ranging in 
difficulty from ten to ninety per cent these means are .455— and .338, 
respectively. The corresponding means of the seventeen items whose 
balance is. between five and ten per cent are thus .411 and .211. 

The mathematical relationship between the two methods is easily 
derived and may be written as follows: 


Biserialr  ~Vpq (1) 


Pearsonr 2 





For purposes of calculation it is suggested that the Pearson formula 
be used written in the following form: 


D(Y2 a M,) 


T yz 


(2) 





Biserial r = 


in which the variable elements are p, z, and Y2; M, and a, being con- 
stant for all the items of the test. A table of p/o,z can readily be made 
with the aid of existing tables of z for successive values of p. 
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ADDITIONAL DATA ON BINOCULAR IMBALANCE AND 
READING 


BRANT CLARK 


Psychology Laboratory, University of Southern California 


INTRODUCTION 


In a previous paper! data were presented to show that during a 
short reading period the eye movements of subjects having high 
exophoria (a tendency of the eyes to turn out) did not differ reliably 
from a control group in regard to the average number of fixations per 
line, the average number of regressions per line, etc. However, the 
exophores did show greater over-convergence movements as the eyes 
moved from the end of one line to the beginning of the next although 
the difference was not highly reliable. In connection with another 
study six subjects who exhibited very high exophoria (fifteen to 
twenty-four diopters at the reading distance) were made available 
and were photographed to determine the nature of their eye movement 
habits. These subjects, in contrast with the previous group, were 
suffering ocular discomfort as a result of the faulty condition of their 
eyes. 


PROCEDURE AND RESULTS 


The experimental procedure was the same as that used in the 
previous experiment. ‘The subjects read the same paragraphs while 
their eye movements were photographed. The ages of the subjects 
of this group ranged between sixteen and thirty-five years. This varia- 
tion in age and familiarity with the material did not permit a compari- 
son of this group with the original control group for the usual reading 
measures, so the photographic records were examined only to determine 
the magnitude and time of the divergence movements which compen- 
sated for the over-convergence of the eyes in moving from the end of 
one line to the beginning of the next. The average extent of the cor- 
rective movements for this experimental group was found to be 
102 + 34.8 minutes as compared to 30.0 + 9.5 minutes for the control 
group. D/e diff. was found to be 5.5. Divergence movements as 
large as two hundred four minutes (the angular equivalent of approxi- 





1 Clark, B.: ‘‘The effect of binocular imbalance on the behavior of the eyes 
during reading.’”’ Journal of Educational Psychology, Vol. XXVI, 1935, pp. 
530-538. 
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mately two.cm. or three words on the page) occurred, and movements 
as large as one hundred fifty minutes were very common. Corrective 
divergence movements occurred after ninety-eight per cent of the 
return sweeps. 

The average time required to complete these divergence move- 
ments was found to be 3.33 + 0.71 twenty-fifth seconds while the time 
for the control group was 2.34 + 0.55 twenty-fifth seconds. (D/ce diff. 
3.3.) In other words, the control group required, on the average, 
about 145 second less time to complete the divergence movements at 
the beginnings of the lines. 

The data also tend to indicate that there are other ocular factors 
which may be important in producing this over-convergence because 
the extent of the binocular imbalance was far from perfectly related 
to the extent of the over-convergence movements, e.g., the subject 
with the largest binocular imbalance (twenty-four diopters) made 
corrective.movements which averaged sixty-eight minutes while the 
subject with the smallest binocular imbalance (fifteen diopters) made 
corrective movements which averaged one hundred forty minutes. 
On the other hand, this group as a whole made larger corrective 
movements than did the previous experimental and control groups 
which had smaller binocular imbalances. There were, however, too 
few subjects in this group to draw definite conclusions concerning this. 

These data lend support to the findings of the previous study in 
that individuals with high binocular imbalances made larger ‘‘fusion”’ 
movements than the subjects of a control group and that any additional 
ocular fatigue resulting from these movements is probably not a fatigue 
of the extra-ocular muscles for the individual ‘‘fusion’?’ movements 
were much slower than and approximately the same size as the inter- 
fixation movements. It is an established fact, however, that “‘fusion”’ 
movements of this sort are very fatiguing, and in an extended reading 
period they probably cause enough fatigue to be of considerable 
importance in a remedial reading program. 


SUMMARY 


A comparison of the eye movement records of subjects having high 
exophoria, which caused ocular discomfort, with the records of a con- 
trol group under the limited reading period of this experiment leads to 
the following conclusions: 

1. The exophoric group made significantly greater divergence 
movements at the beginning of the lines. 
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2. The exophoric group required a significantly greater amount of 
time to complete these divergence movements. 

3. The large divergence movements of the subjects with high 
binocular imbalances probably cause enough fatigue to be important 
in a remedial reading program. 

4. Other ocular factors than the high exophoria may also be impor- 
tant in causing these large divergence movements. 





BOOK REVIEWS 


Fioyp H. Aturort, LYNNETTE WALKER, and ELEANOR LATHERs. 


Written Composition and Characteristics of Personality. New 
York: Archives of Psychology, No. 173, 1934, pp. 82. 


This monograph reports a study of students’ themes from the point 
of view that instruction should not be confined to bringing the student 
up to mechanical standards of good rhetoric and grammar, but should 
also attempt to develop his ability to express his personality, z.e., to do 
creative writing. The experiments involve the development of an 
index of identifiability for each of seventy students, based on the 
number of cases out of a possible eight in which readers are able to 
match themes according to authorship. In any matching, themes from 
all seventy students are not read together, but are taken in groups of 
five. Thus in the first matching, two themes from each of five students 
are presented to the reader, who attempts to pair them before taking 
another group. In the second matching, the reader tries to match five 
new themes (third writing) with five pairs from the first two writings, 
after the first matching has been corrected. In the third matching 
the reader tries to identify each new theme with a particular student’s 
three previous themes, etc. A student is not grouped with the same 
four other students in succeeding matchings, themes on each of the 
three types of topics are not kept together, and practise and fatigue 
of the readers are equalized by having some of a student’s themes read 
early and some late in the experiment. In fact, all such factors which 
might reasonably be suspected as sources of error are systematically 
varied by an elaborate program which might well serve as a laudable 
example of experimental series control. 

In making matchings, the reader makes a progressive chart of 
hypothetical traits of the writer recognizable in his writing, which may 
serve to characterize him and to identify his future themes. One 
weakness of the experiment is the identification of themes on the basis 
of errors rather than entirely on personality characteristics. One 
wonders if the readers were properly instructed to avoid this pitfall. 
It occurs to the reviewer that it could have been avoided by having 
the themes corrected to remove mechanical errors before presenting 
them to the readers. For the purpose of correlating individuality 
with students’ grades, themes could have been graded after having been 
corrected. 
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While we agree with the authors’ justification (p. 16) of the use of 
only two readers, the low r between them, together with the consider- 
able validity of each above chance, indicates the desirability of more 
readers. Also, if a judgment of a theme is partly characteristic of the 
personality of the reader as well as of the writer, or if traits of the reader 
partly blind him to certain traits of the writer, then a larger number of 
readers is indicated. 

To test the hypothesis (p. 30) that the school discourages both too 
much and too little individuality, the authors might have correlated the 
grades with deviations of the identification index from the mean with- 
out regard tosign. Of course, the distribution of deviations would not 
be normal, and the Pearsonian coefficient could not be compared with 
coefficients derived from normal distributions, but this would not be 
necessary for the present purpose. From scattergrams and calcula- 
tions made by the reviewer, he judges the relation too slight to support 
the authors’ hypothesis. The authors are to be commended for 
presenting their raw data in full, a practise which should be more 
popular with experimenters. 

The formulae on page 32 cannot give the values above fifty which 
are reported unless in the first formula the first minus sign is changed 
to plus, in which case the second formula is unnecessary. 

The authors present an interesting defense of the theory of per- 
sonality as a possession of the individual, against the theory of per- 
sonality as a social relation between the individual and the observer. 
Accordingly they hold that the correct value of the identification 
index for an individual is not the average of the two values obtained 
by the two observers but the higher value, on the ground that it is 
prima facie obtained by the one who is more accurate in observing 
that individual. Then the most accurate score would be the highest 
from a large number of observers. Now with an infinite number of 
observers, each subject would receive the maximum possible score 
from some observer or other, hence the true scores of all subjects 
would be equal. Thus the authors’ theory of the identification 
index reduces to absurdity. (If it follows necessarily from their 
theory of personality, then the latter is false to the extent that it 
demands their theory of the index.) The alternative concept of the 
index (that the true value is not the highest value obtained but the 
average from the various observers) seems to us to be demanded 
by the index itself. The authors say that upon this alternative 
theory the index would reflect not what the subject’s “individuality 
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is, but . .-. how much individuality he’ has. Doesn’t a quantitative 
measure on a unidimensional scale always imply not what but how 
much? 

The results of the experiments show that each reader matches the 
themes correctly in fifty per cent of the cases, which is 2.5 times 
chance expectation under the present conditions. The basis of 
identification of the themes is not entirely known but is partly the 
personality of the student as revealed in his writing, partly the mechan- 
ics of his writing, plus (apparently) the reader’s reactions to charac- 
teristics of the themes. The question as to whether the methods of 
teaching influence the identifiability of themes is not answered, 
probably because of the small number of data, as there is some indica- 
tion that reading themes in class and having students discuss them 
encourages individuality more than does formal classroom procedure. 
No relation is found between individuality and: Grades on themes, 
improvement in grades, length of training, nor intelligence. About 
thirty pages are given to case studies and psychological analysis of 
personality as revealed in themes and its relation to faults of writing. 
This portion of the study should be of vital interest to teachers of 
composition. It indicates that a consistent sketch could often be 
made of one’s personality as revealed in his writing, and that some 
errors are not isolated occurrences to be corrected by drill but may 
spring from underlying personality traits. C. R. GARVEY. 

Carnegie Institute of Technology. 


Mapison BENTLEY AND E. V. Cowpry. The Problem of Mental 
Disorder. New York: McGraw-Hill Book Company, 1935, 
pp. 388. 


Can a fundamental knowledge of nature and of man be used 
in a broader and more effective way to improve our understanding of 
mental disorders and presently lead to more effective control? That 
is the question Dr. Bentley, chairman of a committee on psychiatric 
investigations carried on under the auspices of the National Research 
Council, sets up for the committee in the preface to a discussion of 
the findings. The manner of answering the question, so far as one 
can gather from the contents of the book published by the committee, 
is to survey current points of view in the field of psychiatry and to 
search through the many supporting sciences for their possible con- 
tributions. The bulk of the book is concerned with this latter purpose, 





a cen il on Mn <2 Ot og » 


Ss & Ss 


hi: 
de 
tic 
of 
is 
au 
ani 
of 
eal 


the 
Psy 


Dr 
of : 
duc 








tal 


ed 
of 
iat 
ric 
rch 
of 
one 
tee, 
1 to 


ose, 





Book Reviews 479 


and a description of present contributions of twenty supporting 
sciences discussed by that number of authors. Some of the fields 
considered are: Cerebral anatomy and physiology, electrophysiology of 
the brain, neuropathology, biology and genetics, endocrinology, 
nutrition, experimental psychology, anthropology, and education. 
Five points of view in the fields of psychiatry are presented: Clinical 
psychiatry by Dr. C. Macfie Campbell, medical psychiatry by Dr. A. 
Meyerson, the neurologist’s point of view by Dr. I. S. Wechsler, the 
psychobiological point of view by Dr. Adolf Meyer, and the psycho- 
analyst’s point of view by Dr. Lawrence 8. Kubie. All students of the 
nature of man will be interested in this serious attempt to bring 
together the fields of fundamental knowledge with the field of curative 
art. This book should be of particular importance, of course, to 
individuals dealing with human problems in a professional manner. 
To such individuals the content of this book is likely to give a more 
adequate point of orientation for evaluating all investigations and 
therapeutic methods that are now emerging. H. MELTZER. 
Psychological Service Center, St. Louis. 


C. 8. Biuemet. Stammering and Allied Disorders. New York: 
The Macmillan Company, 1935, pp. 182. 


Stammering, according to Dr. Bluemel’s latest conception, is a 
partial or intermittent inhibition of conditioned reflexes. Hence in 
his latest book about stammering more than one-half of the content is 
devoted to a discussion of the topic of conditioned reflexes, condi- 
tioned inhibition, and language and speech considered from the point 
of view of reflexes and inhibitions. In this book a good deal of space 
is also devoted to a re-interpretation of the author’s own earlier 
auditory amnesia explanation, Dr. Swift’s visual imagery explanation 
and even Dr. Travis’s gradient explanation of stammering in terms 
of his present conception of conditioned inhibition. Of his own 
earlier conception he says that it is not materially altered by the 
introduction of the term “inhibition”? but instead is clarified by 
the change in terminology. Certainly most American students of 
psychology will be glad of this change in terminology. 

In a relatively short chapter on the treatment of stammering 
Dr. Bluemel suggests that therapy would be simplified if the mechanics 
of speech were disregarded and if attention were directed to the pro- 
duction of the finished word and sentence, regarded as conditioned 





480 The Journal of Educational Psychology 


reflexes. Medical, psychological and social aspects of treatment are 
also briefly discussed in this chapter. If the book does nothing more 
than give some of the speech teachers who are not too well trained in 
psychological thinking a license to familiarize themselves with psy- 
chological concepts and not confuse themselves with worries concerning 
auditory or visual amnesia explanations it will have rendered a useful 
service. H. MELTZER. 
Psychological Service Center, St. Louis. 





